2023-02-19 07:59:59,835 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-19 07:59:59,880 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=241, ProcessCount=168, AvailableMemoryMB=11464 2023-02-19 08:00:00,154 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0 2023-02-19 08:00:00,163 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 08:00:00,163 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/cluster_b403e41a-8096-f14e-29d8-fd2298438252, deleteOnExit=true 2023-02-19 08:00:00,163 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 08:00:00,164 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/test.cache.data in system properties and HBase conf 2023-02-19 08:00:00,164 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 08:00:00,165 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/hadoop.log.dir in system properties and HBase conf 2023-02-19 08:00:00,165 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 08:00:00,165 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 08:00:00,165 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 08:00:00,252 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-19 08:00:00,595 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 08:00:00,599 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:00,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:00,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 08:00:00,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:00,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 08:00:00,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 08:00:00,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:00,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:00,602 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 08:00:00,602 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/nfs.dump.dir in system properties and HBase conf 2023-02-19 08:00:00,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/java.io.tmpdir in system properties and HBase conf 2023-02-19 08:00:00,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:00,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 08:00:00,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 08:00:01,111 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:01,116 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:01,373 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-19 08:00:01,533 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-19 08:00:01,550 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:01,584 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:01,619 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/java.io.tmpdir/Jetty_localhost_38149_hdfs____.w626w5/webapp 2023-02-19 08:00:01,769 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38149 2023-02-19 08:00:01,781 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:01,782 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:02,290 WARN [Listener at localhost/33697] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:02,386 WARN [Listener at localhost/33697] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:02,409 WARN [Listener at localhost/33697] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:02,416 INFO [Listener at localhost/33697] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:02,421 INFO [Listener at localhost/33697] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/java.io.tmpdir/Jetty_localhost_43405_datanode____.7r5m0v/webapp 2023-02-19 08:00:02,527 INFO [Listener at localhost/33697] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43405 2023-02-19 08:00:02,973 WARN [Listener at localhost/39677] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:03,044 WARN [Listener at localhost/39677] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:03,052 WARN [Listener at localhost/39677] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:03,054 INFO [Listener at localhost/39677] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:03,065 INFO [Listener at localhost/39677] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/java.io.tmpdir/Jetty_localhost_38623_datanode____.ti6nqf/webapp 2023-02-19 08:00:03,210 INFO [Listener at localhost/39677] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38623 2023-02-19 08:00:03,230 WARN [Listener at localhost/37093] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:03,550 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcce7a3eebaa7d1a2: Processing first storage report for DS-674ec7f7-38d9-4e01-b929-540bb031d473 from datanode c5141124-e15d-46f4-9cff-5c91d1131c3f 2023-02-19 08:00:03,552 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcce7a3eebaa7d1a2: from storage DS-674ec7f7-38d9-4e01-b929-540bb031d473 node DatanodeRegistration(127.0.0.1:41989, datanodeUuid=c5141124-e15d-46f4-9cff-5c91d1131c3f, infoPort=40445, infoSecurePort=0, ipcPort=39677, storageInfo=lv=-57;cid=testClusterID;nsid=225073423;c=1676793601182), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-19 08:00:03,552 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1eda04a3193415c: Processing first storage report for DS-36d6309e-8b55-4e30-9ce5-d3d2ce80e522 from datanode d7c6b436-5136-4b2b-886e-872415f736db 2023-02-19 08:00:03,552 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1eda04a3193415c: from storage DS-36d6309e-8b55-4e30-9ce5-d3d2ce80e522 node DatanodeRegistration(127.0.0.1:39833, datanodeUuid=d7c6b436-5136-4b2b-886e-872415f736db, infoPort=32801, infoSecurePort=0, ipcPort=37093, storageInfo=lv=-57;cid=testClusterID;nsid=225073423;c=1676793601182), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:03,552 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcce7a3eebaa7d1a2: Processing first storage report for DS-3d1d2ff5-8897-4ca0-9c64-df64c788789a from datanode c5141124-e15d-46f4-9cff-5c91d1131c3f 2023-02-19 08:00:03,552 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcce7a3eebaa7d1a2: from storage DS-3d1d2ff5-8897-4ca0-9c64-df64c788789a node DatanodeRegistration(127.0.0.1:41989, datanodeUuid=c5141124-e15d-46f4-9cff-5c91d1131c3f, infoPort=40445, infoSecurePort=0, ipcPort=39677, storageInfo=lv=-57;cid=testClusterID;nsid=225073423;c=1676793601182), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:03,552 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1eda04a3193415c: Processing first storage report for DS-8f0806a4-d62a-411e-9e1d-48ab40e6cef4 from datanode d7c6b436-5136-4b2b-886e-872415f736db 2023-02-19 08:00:03,552 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1eda04a3193415c: from storage DS-8f0806a4-d62a-411e-9e1d-48ab40e6cef4 node DatanodeRegistration(127.0.0.1:39833, datanodeUuid=d7c6b436-5136-4b2b-886e-872415f736db, infoPort=32801, infoSecurePort=0, ipcPort=37093, storageInfo=lv=-57;cid=testClusterID;nsid=225073423;c=1676793601182), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:03,669 DEBUG [Listener at localhost/37093] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0 2023-02-19 08:00:03,764 INFO [Listener at localhost/37093] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/cluster_b403e41a-8096-f14e-29d8-fd2298438252/zookeeper_0, clientPort=57971, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/cluster_b403e41a-8096-f14e-29d8-fd2298438252/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/cluster_b403e41a-8096-f14e-29d8-fd2298438252/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 08:00:03,782 INFO [Listener at localhost/37093] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57971 2023-02-19 08:00:03,797 INFO [Listener at localhost/37093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:03,800 INFO [Listener at localhost/37093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:04,497 INFO [Listener at localhost/37093] util.FSUtils(479): Created version file at hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48 with version=8 2023-02-19 08:00:04,498 INFO [Listener at localhost/37093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:04,499 INFO [Listener at localhost/37093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:04,502 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/hbase-staging 2023-02-19 08:00:04,832 INFO [Listener at localhost/37093] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-19 08:00:05,343 INFO [Listener at localhost/37093] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:05,376 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:05,377 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:05,377 INFO [Listener at localhost/37093] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:05,377 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:05,377 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:05,520 INFO [Listener at localhost/37093] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:05,593 DEBUG [Listener at localhost/37093] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-19 08:00:05,689 INFO [Listener at localhost/37093] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32887 2023-02-19 08:00:05,699 INFO [Listener at localhost/37093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:05,701 INFO [Listener at localhost/37093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:05,723 INFO [Listener at localhost/37093] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32887 connecting to ZooKeeper ensemble=127.0.0.1:57971 2023-02-19 08:00:05,768 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:328870x0, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:05,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:32887-0x1006b97d0630000 connected 2023-02-19 08:00:05,805 DEBUG [Listener at localhost/37093] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:05,806 DEBUG [Listener at localhost/37093] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:05,811 DEBUG [Listener at localhost/37093] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:05,822 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32887 2023-02-19 08:00:05,823 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32887 2023-02-19 08:00:05,824 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32887 2023-02-19 08:00:05,824 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32887 2023-02-19 08:00:05,825 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32887 2023-02-19 08:00:05,833 INFO [Listener at localhost/37093] master.HMaster(444): hbase.rootdir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48, hbase.cluster.distributed=false 2023-02-19 08:00:05,917 INFO [Listener at localhost/37093] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:05,917 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:05,917 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:05,917 INFO [Listener at localhost/37093] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:05,918 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:05,918 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:05,922 INFO [Listener at localhost/37093] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:05,925 INFO [Listener at localhost/37093] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43525 2023-02-19 08:00:05,928 INFO [Listener at localhost/37093] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:05,935 DEBUG [Listener at localhost/37093] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:05,936 INFO [Listener at localhost/37093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:05,938 INFO [Listener at localhost/37093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:05,939 INFO [Listener at localhost/37093] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43525 connecting to ZooKeeper ensemble=127.0.0.1:57971 2023-02-19 08:00:05,943 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:435250x0, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:05,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43525-0x1006b97d0630001 connected 2023-02-19 08:00:05,945 DEBUG [Listener at localhost/37093] zookeeper.ZKUtil(164): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:05,946 DEBUG [Listener at localhost/37093] zookeeper.ZKUtil(164): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:05,947 DEBUG [Listener at localhost/37093] zookeeper.ZKUtil(164): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:05,948 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43525 2023-02-19 08:00:05,952 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43525 2023-02-19 08:00:05,952 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43525 2023-02-19 08:00:05,953 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43525 2023-02-19 08:00:05,953 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43525 2023-02-19 08:00:05,966 INFO [Listener at localhost/37093] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:05,966 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:05,966 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:05,966 INFO [Listener at localhost/37093] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:05,967 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:05,967 INFO [Listener at localhost/37093] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:05,967 INFO [Listener at localhost/37093] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:05,968 INFO [Listener at localhost/37093] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35991 2023-02-19 08:00:05,969 INFO [Listener at localhost/37093] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:05,972 DEBUG [Listener at localhost/37093] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:05,973 INFO [Listener at localhost/37093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:05,976 INFO [Listener at localhost/37093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:05,979 INFO [Listener at localhost/37093] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35991 connecting to ZooKeeper ensemble=127.0.0.1:57971 2023-02-19 08:00:05,984 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:359910x0, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:05,985 DEBUG [Listener at localhost/37093] zookeeper.ZKUtil(164): regionserver:359910x0, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:05,986 DEBUG [Listener at localhost/37093] zookeeper.ZKUtil(164): regionserver:359910x0, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:05,987 DEBUG [Listener at localhost/37093] zookeeper.ZKUtil(164): regionserver:359910x0, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:05,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35991-0x1006b97d0630002 connected 2023-02-19 08:00:05,988 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35991 2023-02-19 08:00:05,989 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35991 2023-02-19 08:00:05,990 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35991 2023-02-19 08:00:05,990 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35991 2023-02-19 08:00:05,991 DEBUG [Listener at localhost/37093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35991 2023-02-19 08:00:05,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,32887,1676793604664 2023-02-19 08:00:06,005 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:06,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,32887,1676793604664 2023-02-19 08:00:06,031 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:06,031 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:06,031 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:06,031 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:06,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:06,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,32887,1676793604664 from backup master directory 2023-02-19 08:00:06,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:06,037 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,32887,1676793604664 2023-02-19 08:00:06,037 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:06,038 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:06,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,32887,1676793604664 2023-02-19 08:00:06,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-19 08:00:06,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-19 08:00:06,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/hbase.id with ID: d2daac77-a630-4b3d-8a1e-fa808fc49392 2023-02-19 08:00:06,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:06,205 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:06,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x22278d21 to 127.0.0.1:57971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:06,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@766d6cda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:06,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:06,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 08:00:06,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-19 08:00:06,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-19 08:00:06,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-19 08:00:06,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-19 08:00:06,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:06,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/data/master/store-tmp 2023-02-19 08:00:06,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:06,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:06,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:06,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:06,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:06,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:06,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:06,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:06,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/WALs/jenkins-hbase4.apache.org,32887,1676793604664 2023-02-19 08:00:06,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32887%2C1676793604664, suffix=, logDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/WALs/jenkins-hbase4.apache.org,32887,1676793604664, archiveDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/oldWALs, maxLogs=10 2023-02-19 08:00:06,529 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41989,DS-674ec7f7-38d9-4e01-b929-540bb031d473,DISK] 2023-02-19 08:00:06,529 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39833,DS-36d6309e-8b55-4e30-9ce5-d3d2ce80e522,DISK] 2023-02-19 08:00:06,538 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-19 08:00:06,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/WALs/jenkins-hbase4.apache.org,32887,1676793604664/jenkins-hbase4.apache.org%2C32887%2C1676793604664.1676793606478 2023-02-19 08:00:06,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39833,DS-36d6309e-8b55-4e30-9ce5-d3d2ce80e522,DISK], DatanodeInfoWithStorage[127.0.0.1:41989,DS-674ec7f7-38d9-4e01-b929-540bb031d473,DISK]] 2023-02-19 08:00:06,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:06,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:06,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:06,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:06,696 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:06,703 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 08:00:06,737 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 08:00:06,749 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:06,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:06,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:06,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:06,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:06,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68164605, jitterRate=0.01573176681995392}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:06,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:06,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 08:00:06,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 08:00:06,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 08:00:06,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 08:00:06,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-19 08:00:06,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-02-19 08:00:06,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 08:00:06,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 08:00:06,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 08:00:06,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 08:00:06,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 08:00:06,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 08:00:06,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 08:00:06,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 08:00:06,930 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:06,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 08:00:06,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 08:00:06,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 08:00:06,958 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:06,958 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:06,959 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:06,958 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:06,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,32887,1676793604664, sessionid=0x1006b97d0630000, setting cluster-up flag (Was=false) 2023-02-19 08:00:06,983 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:06,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 08:00:06,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32887,1676793604664 2023-02-19 08:00:07,001 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:07,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 08:00:07,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32887,1676793604664 2023-02-19 08:00:07,021 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.hbase-snapshot/.tmp 2023-02-19 08:00:07,098 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(952): ClusterId : d2daac77-a630-4b3d-8a1e-fa808fc49392 2023-02-19 08:00:07,101 INFO [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(952): ClusterId : d2daac77-a630-4b3d-8a1e-fa808fc49392 2023-02-19 08:00:07,106 DEBUG [RS:1;jenkins-hbase4:35991] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:07,106 DEBUG [RS:0;jenkins-hbase4:43525] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:07,113 DEBUG [RS:0;jenkins-hbase4:43525] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:07,113 DEBUG [RS:1;jenkins-hbase4:35991] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:07,113 DEBUG [RS:0;jenkins-hbase4:43525] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:07,114 DEBUG [RS:1;jenkins-hbase4:35991] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:07,118 DEBUG [RS:1;jenkins-hbase4:35991] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:07,118 DEBUG [RS:0;jenkins-hbase4:43525] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:07,120 DEBUG [RS:1;jenkins-hbase4:35991] zookeeper.ReadOnlyZKClient(139): Connect 0x17d1ae5e to 127.0.0.1:57971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:07,120 DEBUG [RS:0;jenkins-hbase4:43525] zookeeper.ReadOnlyZKClient(139): Connect 0x10a01dde to 127.0.0.1:57971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:07,132 DEBUG [RS:1;jenkins-hbase4:35991] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d27e08e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:07,132 DEBUG [RS:0;jenkins-hbase4:43525] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fcc681a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:07,132 DEBUG [RS:1;jenkins-hbase4:35991] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f5dfa46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:07,132 DEBUG [RS:0;jenkins-hbase4:43525] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b4ba34e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:07,161 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43525 2023-02-19 08:00:07,165 DEBUG [RS:1;jenkins-hbase4:35991] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35991 2023-02-19 08:00:07,166 INFO [RS:0;jenkins-hbase4:43525] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:07,166 INFO [RS:1;jenkins-hbase4:35991] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:07,167 INFO [RS:0;jenkins-hbase4:43525] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:07,167 INFO [RS:1;jenkins-hbase4:35991] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:07,167 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:07,167 DEBUG [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:07,170 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32887,1676793604664 with isa=jenkins-hbase4.apache.org/172.31.14.131:43525, startcode=1676793605916 2023-02-19 08:00:07,170 INFO [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32887,1676793604664 with isa=jenkins-hbase4.apache.org/172.31.14.131:35991, startcode=1676793605965 2023-02-19 08:00:07,194 DEBUG [RS:0;jenkins-hbase4:43525] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:07,194 DEBUG [RS:1;jenkins-hbase4:35991] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:07,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:07,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:07,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:07,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:07,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:07,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 08:00:07,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:07,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:07,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:07,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676793637224 2023-02-19 08:00:07,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 08:00:07,237 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:07,238 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 08:00:07,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 08:00:07,245 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:07,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 08:00:07,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 08:00:07,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 08:00:07,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 08:00:07,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:07,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 08:00:07,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 08:00:07,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 08:00:07,260 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38791, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:07,260 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52745, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:07,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 08:00:07,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 08:00:07,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793607271,5,FailOnTimeoutGroup] 2023-02-19 08:00:07,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793607271,5,FailOnTimeoutGroup] 2023-02-19 08:00:07,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:07,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 08:00:07,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 08:00:07,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:07,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32887] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 08:00:07,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:07,309 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:07,310 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:07,311 INFO [PEWorker-2] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48 2023-02-19 08:00:07,318 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(2829): Master is not running yet 2023-02-19 08:00:07,318 DEBUG [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(2829): Master is not running yet 2023-02-19 08:00:07,319 WARN [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-19 08:00:07,319 WARN [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-19 08:00:07,336 DEBUG [PEWorker-2] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:07,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:07,341 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/info 2023-02-19 08:00:07,342 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:07,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:07,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:07,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:07,346 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:07,347 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:07,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:07,350 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/table 2023-02-19 08:00:07,351 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:07,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:07,353 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740 2023-02-19 08:00:07,354 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740 2023-02-19 08:00:07,358 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:07,360 DEBUG [PEWorker-2] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:07,366 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:07,368 INFO [PEWorker-2] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61971278, jitterRate=-0.076555997133255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:07,368 DEBUG [PEWorker-2] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:07,368 DEBUG [PEWorker-2] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:07,368 INFO [PEWorker-2] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:07,368 DEBUG [PEWorker-2] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:07,368 DEBUG [PEWorker-2] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:07,368 DEBUG [PEWorker-2] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:07,369 INFO [PEWorker-2] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:07,369 DEBUG [PEWorker-2] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:07,376 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:07,376 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 08:00:07,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 08:00:07,397 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 08:00:07,401 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 08:00:07,551 WARN [jenkins-hbase4:32887] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-19 08:00:08,320 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32887,1676793604664 with isa=jenkins-hbase4.apache.org/172.31.14.131:43525, startcode=1676793605916 2023-02-19 08:00:08,320 INFO [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32887,1676793604664 with isa=jenkins-hbase4.apache.org/172.31.14.131:35991, startcode=1676793605965 2023-02-19 08:00:08,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:08,326 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32887] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:08,333 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48 2023-02-19 08:00:08,333 DEBUG [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48 2023-02-19 08:00:08,334 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33697 2023-02-19 08:00:08,334 DEBUG [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33697 2023-02-19 08:00:08,334 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:08,334 DEBUG [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:08,344 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:08,345 DEBUG [RS:1;jenkins-hbase4:35991] zookeeper.ZKUtil(162): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:08,345 DEBUG [RS:0;jenkins-hbase4:43525] zookeeper.ZKUtil(162): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:08,345 WARN [RS:1;jenkins-hbase4:35991] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:08,345 WARN [RS:0;jenkins-hbase4:43525] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:08,345 INFO [RS:1;jenkins-hbase4:35991] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:08,345 INFO [RS:0;jenkins-hbase4:43525] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:08,346 DEBUG [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/WALs/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:08,346 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/WALs/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:08,346 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35991,1676793605965] 2023-02-19 08:00:08,347 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43525,1676793605916] 2023-02-19 08:00:08,357 DEBUG [RS:1;jenkins-hbase4:35991] zookeeper.ZKUtil(162): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:08,357 DEBUG [RS:0;jenkins-hbase4:43525] zookeeper.ZKUtil(162): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:08,358 DEBUG [RS:0;jenkins-hbase4:43525] zookeeper.ZKUtil(162): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:08,358 DEBUG [RS:1;jenkins-hbase4:35991] zookeeper.ZKUtil(162): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:08,371 DEBUG [RS:1;jenkins-hbase4:35991] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:08,371 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:08,382 INFO [RS:0;jenkins-hbase4:43525] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:08,382 INFO [RS:1;jenkins-hbase4:35991] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:08,402 INFO [RS:1;jenkins-hbase4:35991] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:08,402 INFO [RS:0;jenkins-hbase4:43525] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:08,408 INFO [RS:1;jenkins-hbase4:35991] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:08,408 INFO [RS:0;jenkins-hbase4:43525] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:08,409 INFO [RS:1;jenkins-hbase4:35991] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,409 INFO [RS:0;jenkins-hbase4:43525] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,410 INFO [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:08,410 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:08,419 INFO [RS:0;jenkins-hbase4:43525] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,419 INFO [RS:1;jenkins-hbase4:35991] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,419 DEBUG [RS:0;jenkins-hbase4:43525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,420 DEBUG [RS:1;jenkins-hbase4:35991] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,420 DEBUG [RS:0;jenkins-hbase4:43525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,420 DEBUG [RS:1;jenkins-hbase4:35991] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,420 DEBUG [RS:0;jenkins-hbase4:43525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,420 DEBUG [RS:1;jenkins-hbase4:35991] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,420 DEBUG [RS:0;jenkins-hbase4:43525] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,420 DEBUG [RS:1;jenkins-hbase4:35991] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,420 DEBUG [RS:0;jenkins-hbase4:43525] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,421 DEBUG [RS:1;jenkins-hbase4:35991] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,421 DEBUG [RS:0;jenkins-hbase4:43525] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:08,421 DEBUG [RS:1;jenkins-hbase4:35991] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:08,421 DEBUG [RS:0;jenkins-hbase4:43525] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,421 DEBUG [RS:1;jenkins-hbase4:35991] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,421 DEBUG [RS:0;jenkins-hbase4:43525] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,421 DEBUG [RS:1;jenkins-hbase4:35991] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,421 DEBUG [RS:0;jenkins-hbase4:43525] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,421 DEBUG [RS:1;jenkins-hbase4:35991] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,422 DEBUG [RS:0;jenkins-hbase4:43525] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,422 DEBUG [RS:1;jenkins-hbase4:35991] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:08,423 INFO [RS:0;jenkins-hbase4:43525] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,423 INFO [RS:0;jenkins-hbase4:43525] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,423 INFO [RS:0;jenkins-hbase4:43525] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,423 INFO [RS:1;jenkins-hbase4:35991] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,423 INFO [RS:1;jenkins-hbase4:35991] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,423 INFO [RS:1;jenkins-hbase4:35991] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,442 INFO [RS:0;jenkins-hbase4:43525] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:08,442 INFO [RS:1;jenkins-hbase4:35991] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:08,446 INFO [RS:0;jenkins-hbase4:43525] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43525,1676793605916-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,446 INFO [RS:1;jenkins-hbase4:35991] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35991,1676793605965-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:08,464 INFO [RS:0;jenkins-hbase4:43525] regionserver.Replication(203): jenkins-hbase4.apache.org,43525,1676793605916 started 2023-02-19 08:00:08,464 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43525,1676793605916, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43525, sessionid=0x1006b97d0630001 2023-02-19 08:00:08,464 INFO [RS:1;jenkins-hbase4:35991] regionserver.Replication(203): jenkins-hbase4.apache.org,35991,1676793605965 started 2023-02-19 08:00:08,464 INFO [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35991,1676793605965, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35991, sessionid=0x1006b97d0630002 2023-02-19 08:00:08,464 DEBUG [RS:0;jenkins-hbase4:43525] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:08,464 DEBUG [RS:1;jenkins-hbase4:35991] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:08,464 DEBUG [RS:0;jenkins-hbase4:43525] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:08,465 DEBUG [RS:1;jenkins-hbase4:35991] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:08,465 DEBUG [RS:0;jenkins-hbase4:43525] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43525,1676793605916' 2023-02-19 08:00:08,465 DEBUG [RS:1;jenkins-hbase4:35991] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35991,1676793605965' 2023-02-19 08:00:08,466 DEBUG [RS:1;jenkins-hbase4:35991] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:08,466 DEBUG [RS:0;jenkins-hbase4:43525] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:08,467 DEBUG [RS:1;jenkins-hbase4:35991] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:08,467 DEBUG [RS:0;jenkins-hbase4:43525] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:08,467 DEBUG [RS:1;jenkins-hbase4:35991] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:08,467 DEBUG [RS:1;jenkins-hbase4:35991] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:08,467 DEBUG [RS:1;jenkins-hbase4:35991] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:08,467 DEBUG [RS:1;jenkins-hbase4:35991] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35991,1676793605965' 2023-02-19 08:00:08,467 DEBUG [RS:0;jenkins-hbase4:43525] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:08,467 DEBUG [RS:1;jenkins-hbase4:35991] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:08,468 DEBUG [RS:0;jenkins-hbase4:43525] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:08,468 DEBUG [RS:0;jenkins-hbase4:43525] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:08,468 DEBUG [RS:0;jenkins-hbase4:43525] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43525,1676793605916' 2023-02-19 08:00:08,468 DEBUG [RS:0;jenkins-hbase4:43525] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:08,468 DEBUG [RS:1;jenkins-hbase4:35991] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:08,469 DEBUG [RS:0;jenkins-hbase4:43525] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:08,469 DEBUG [RS:1;jenkins-hbase4:35991] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:08,469 INFO [RS:1;jenkins-hbase4:35991] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:08,469 INFO [RS:1;jenkins-hbase4:35991] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:08,470 DEBUG [RS:0;jenkins-hbase4:43525] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:08,470 INFO [RS:0;jenkins-hbase4:43525] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:08,470 INFO [RS:0;jenkins-hbase4:43525] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:08,554 DEBUG [jenkins-hbase4:32887] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 08:00:08,559 DEBUG [jenkins-hbase4:32887] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:08,565 DEBUG [jenkins-hbase4:32887] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:08,565 DEBUG [jenkins-hbase4:32887] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:08,565 DEBUG [jenkins-hbase4:32887] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:08,568 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43525,1676793605916, state=OPENING 2023-02-19 08:00:08,575 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 08:00:08,576 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:08,577 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:08,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:08,772 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:08,774 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:08,778 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40230, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:08,790 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 08:00:08,791 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:08,794 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43525%2C1676793605916.meta, suffix=.meta, logDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/WALs/jenkins-hbase4.apache.org,43525,1676793605916, archiveDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/oldWALs, maxLogs=32 2023-02-19 08:00:08,819 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41989,DS-674ec7f7-38d9-4e01-b929-540bb031d473,DISK] 2023-02-19 08:00:08,819 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39833,DS-36d6309e-8b55-4e30-9ce5-d3d2ce80e522,DISK] 2023-02-19 08:00:08,823 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/WALs/jenkins-hbase4.apache.org,43525,1676793605916/jenkins-hbase4.apache.org%2C43525%2C1676793605916.meta.1676793608799.meta 2023-02-19 08:00:08,824 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41989,DS-674ec7f7-38d9-4e01-b929-540bb031d473,DISK], DatanodeInfoWithStorage[127.0.0.1:39833,DS-36d6309e-8b55-4e30-9ce5-d3d2ce80e522,DISK]] 2023-02-19 08:00:08,824 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:08,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 08:00:08,842 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 08:00:08,848 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 08:00:08,853 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 08:00:08,853 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:08,853 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 08:00:08,854 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 08:00:08,857 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:08,858 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/info 2023-02-19 08:00:08,858 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/info 2023-02-19 08:00:08,859 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:08,860 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:08,860 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:08,862 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:08,862 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:08,862 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:08,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:08,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:08,865 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/table 2023-02-19 08:00:08,865 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/table 2023-02-19 08:00:08,866 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:08,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:08,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740 2023-02-19 08:00:08,873 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740 2023-02-19 08:00:08,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:08,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:08,880 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67180962, jitterRate=0.0010743439197540283}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:08,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:08,890 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676793608764 2023-02-19 08:00:08,913 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 08:00:08,914 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 08:00:08,915 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43525,1676793605916, state=OPEN 2023-02-19 08:00:08,918 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 08:00:08,918 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:08,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 08:00:08,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43525,1676793605916 in 336 msec 2023-02-19 08:00:08,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 08:00:08,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5380 sec 2023-02-19 08:00:08,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.8270 sec 2023-02-19 08:00:08,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676793608932, completionTime=-1 2023-02-19 08:00:08,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 08:00:08,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 08:00:08,999 DEBUG [hconnection-0x31183d0a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:09,002 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40246, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:09,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 08:00:09,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676793669020 2023-02-19 08:00:09,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676793729020 2023-02-19 08:00:09,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 87 msec 2023-02-19 08:00:09,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32887,1676793604664-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:09,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32887,1676793604664-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:09,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32887,1676793604664-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:09,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:32887, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:09,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:09,055 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 08:00:09,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 08:00:09,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:09,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 08:00:09,078 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:09,081 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:09,104 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:09,107 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b empty. 2023-02-19 08:00:09,108 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:09,108 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 08:00:09,134 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:09,137 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => bdb320c7b86679caae80508e68d9800b, NAME => 'hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:09,153 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:09,154 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing bdb320c7b86679caae80508e68d9800b, disabling compactions & flushes 2023-02-19 08:00:09,154 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:09,154 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:09,154 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. after waiting 0 ms 2023-02-19 08:00:09,154 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:09,154 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:09,154 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for bdb320c7b86679caae80508e68d9800b: 2023-02-19 08:00:09,159 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:09,174 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793609162"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793609162"}]},"ts":"1676793609162"} 2023-02-19 08:00:09,202 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:09,205 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:09,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793609205"}]},"ts":"1676793609205"} 2023-02-19 08:00:09,214 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 08:00:09,218 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:09,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:09,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:09,220 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:09,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bdb320c7b86679caae80508e68d9800b, ASSIGN}] 2023-02-19 08:00:09,226 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bdb320c7b86679caae80508e68d9800b, ASSIGN 2023-02-19 08:00:09,228 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=bdb320c7b86679caae80508e68d9800b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43525,1676793605916; forceNewPlan=false, retain=false 2023-02-19 08:00:09,381 INFO [jenkins-hbase4:32887] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:09,382 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bdb320c7b86679caae80508e68d9800b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:09,382 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793609381"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793609381"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793609381"}]},"ts":"1676793609381"} 2023-02-19 08:00:09,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure bdb320c7b86679caae80508e68d9800b, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:09,480 INFO [RS:1;jenkins-hbase4:35991] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35991%2C1676793605965, suffix=, logDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/WALs/jenkins-hbase4.apache.org,35991,1676793605965, archiveDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/oldWALs, maxLogs=32 2023-02-19 08:00:09,480 INFO [RS:0;jenkins-hbase4:43525] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43525%2C1676793605916, suffix=, logDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/WALs/jenkins-hbase4.apache.org,43525,1676793605916, archiveDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/oldWALs, maxLogs=32 2023-02-19 08:00:09,510 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39833,DS-36d6309e-8b55-4e30-9ce5-d3d2ce80e522,DISK] 2023-02-19 08:00:09,510 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39833,DS-36d6309e-8b55-4e30-9ce5-d3d2ce80e522,DISK] 2023-02-19 08:00:09,510 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41989,DS-674ec7f7-38d9-4e01-b929-540bb031d473,DISK] 2023-02-19 08:00:09,511 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41989,DS-674ec7f7-38d9-4e01-b929-540bb031d473,DISK] 2023-02-19 08:00:09,517 INFO [RS:1;jenkins-hbase4:35991] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/WALs/jenkins-hbase4.apache.org,35991,1676793605965/jenkins-hbase4.apache.org%2C35991%2C1676793605965.1676793609483 2023-02-19 08:00:09,517 INFO [RS:0;jenkins-hbase4:43525] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/WALs/jenkins-hbase4.apache.org,43525,1676793605916/jenkins-hbase4.apache.org%2C43525%2C1676793605916.1676793609483 2023-02-19 08:00:09,531 DEBUG [RS:1;jenkins-hbase4:35991] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39833,DS-36d6309e-8b55-4e30-9ce5-d3d2ce80e522,DISK], DatanodeInfoWithStorage[127.0.0.1:41989,DS-674ec7f7-38d9-4e01-b929-540bb031d473,DISK]] 2023-02-19 08:00:09,532 DEBUG [RS:0;jenkins-hbase4:43525] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39833,DS-36d6309e-8b55-4e30-9ce5-d3d2ce80e522,DISK], DatanodeInfoWithStorage[127.0.0.1:41989,DS-674ec7f7-38d9-4e01-b929-540bb031d473,DISK]] 2023-02-19 08:00:09,550 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:09,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bdb320c7b86679caae80508e68d9800b, NAME => 'hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:09,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:09,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:09,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:09,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:09,559 INFO [StoreOpener-bdb320c7b86679caae80508e68d9800b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:09,561 DEBUG [StoreOpener-bdb320c7b86679caae80508e68d9800b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b/info 2023-02-19 08:00:09,561 DEBUG [StoreOpener-bdb320c7b86679caae80508e68d9800b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b/info 2023-02-19 08:00:09,562 INFO [StoreOpener-bdb320c7b86679caae80508e68d9800b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdb320c7b86679caae80508e68d9800b columnFamilyName info 2023-02-19 08:00:09,563 INFO [StoreOpener-bdb320c7b86679caae80508e68d9800b-1] regionserver.HStore(310): Store=bdb320c7b86679caae80508e68d9800b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:09,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:09,565 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:09,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:09,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:09,575 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bdb320c7b86679caae80508e68d9800b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62365265, jitterRate=-0.07068513333797455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:09,575 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bdb320c7b86679caae80508e68d9800b: 2023-02-19 08:00:09,592 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b., pid=6, masterSystemTime=1676793609543 2023-02-19 08:00:09,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:09,600 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:09,609 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bdb320c7b86679caae80508e68d9800b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:09,610 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793609608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793609608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793609608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793609608"}]},"ts":"1676793609608"} 2023-02-19 08:00:09,623 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 08:00:09,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure bdb320c7b86679caae80508e68d9800b, server=jenkins-hbase4.apache.org,43525,1676793605916 in 230 msec 2023-02-19 08:00:09,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 08:00:09,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=bdb320c7b86679caae80508e68d9800b, ASSIGN in 401 msec 2023-02-19 08:00:09,631 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:09,632 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793609632"}]},"ts":"1676793609632"} 2023-02-19 08:00:09,636 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 08:00:09,642 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:09,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 576 msec 2023-02-19 08:00:09,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 08:00:09,680 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:09,680 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:09,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 08:00:09,737 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:09,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-02-19 08:00:09,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 08:00:09,765 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:09,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-19 08:00:09,779 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 08:00:09,783 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 08:00:09,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.744sec 2023-02-19 08:00:09,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 08:00:09,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 08:00:09,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 08:00:09,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32887,1676793604664-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 08:00:09,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32887,1676793604664-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 08:00:09,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 08:00:09,812 DEBUG [Listener at localhost/37093] zookeeper.ReadOnlyZKClient(139): Connect 0x10cc2535 to 127.0.0.1:57971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:09,820 DEBUG [Listener at localhost/37093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35a652b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:09,878 DEBUG [hconnection-0x7255a7db-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:09,890 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40258, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:09,901 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,32887,1676793604664 2023-02-19 08:00:09,901 DEBUG [Listener at localhost/37093] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 08:00:09,910 DEBUG [Listener at localhost/37093] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 08:00:09,912 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57020, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 08:00:09,916 INFO [Listener at localhost/37093] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 08:00:09,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 08:00:09,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 08:00:09,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:57020 deadline: 1676793669920, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-19 08:00:09,923 INFO [Listener at localhost/37093] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-19 08:00:09,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:09,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-19 08:00:09,942 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:09,944 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:09,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-19 08:00:09,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:09,966 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:09,966 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:09,967 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b 2023-02-19 08:00:09,967 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:09,967 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:09,967 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64 empty. 2023-02-19 08:00:09,968 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839 2023-02-19 08:00:09,968 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b empty. 2023-02-19 08:00:09,968 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:09,968 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:09,968 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5 empty. 2023-02-19 08:00:09,968 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658 empty. 2023-02-19 08:00:09,968 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6 empty. 2023-02-19 08:00:09,969 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839 empty. 2023-02-19 08:00:09,970 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:09,970 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:09,971 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b 2023-02-19 08:00:09,971 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:09,971 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:09,971 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839 2023-02-19 08:00:09,971 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:09,971 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:09,971 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa empty. 2023-02-19 08:00:09,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9 empty. 2023-02-19 08:00:09,972 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0 empty. 2023-02-19 08:00:09,972 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587 empty. 2023-02-19 08:00:09,972 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:09,972 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:09,972 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:09,973 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:09,973 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 08:00:09,994 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:09,997 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 735a3357f6a3e4596852ead7c0349d64, NAME => 'testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:09,997 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 12f858663eed44690e97863779d6c54b, NAME => 'testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:09,997 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 10266b2fcaa6ab45dac12ab3031b14e6, NAME => 'testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:10,073 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:10,074 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,074 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 735a3357f6a3e4596852ead7c0349d64, disabling compactions & flushes 2023-02-19 08:00:10,075 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:10,075 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:10,075 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. after waiting 0 ms 2023-02-19 08:00:10,075 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:10,075 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:10,075 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 735a3357f6a3e4596852ead7c0349d64: 2023-02-19 08:00:10,076 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 12f858663eed44690e97863779d6c54b, disabling compactions & flushes 2023-02-19 08:00:10,076 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 41e4f80f1dcd267361d2089538740658, NAME => 'testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:10,076 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:10,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:10,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. after waiting 0 ms 2023-02-19 08:00:10,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:10,077 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:10,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 12f858663eed44690e97863779d6c54b: 2023-02-19 08:00:10,077 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a1c986905b4b75c76cb545a48eca56d5, NAME => 'testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:10,077 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 10266b2fcaa6ab45dac12ab3031b14e6, disabling compactions & flushes 2023-02-19 08:00:10,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:10,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:10,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. after waiting 0 ms 2023-02-19 08:00:10,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:10,078 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:10,078 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 10266b2fcaa6ab45dac12ab3031b14e6: 2023-02-19 08:00:10,079 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 377808f4fc665932de9d53239fd64839, NAME => 'testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:10,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 377808f4fc665932de9d53239fd64839, disabling compactions & flushes 2023-02-19 08:00:10,106 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:10,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:10,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. after waiting 0 ms 2023-02-19 08:00:10,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:10,106 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,108 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:10,108 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a1c986905b4b75c76cb545a48eca56d5, disabling compactions & flushes 2023-02-19 08:00:10,107 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 41e4f80f1dcd267361d2089538740658, disabling compactions & flushes 2023-02-19 08:00:10,108 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:10,108 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 377808f4fc665932de9d53239fd64839: 2023-02-19 08:00:10,108 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:10,108 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:10,108 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => dcd361eae0971a2967db576c98a25ff9, NAME => 'testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:10,109 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:10,109 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. after waiting 0 ms 2023-02-19 08:00:10,109 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. after waiting 0 ms 2023-02-19 08:00:10,109 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:10,109 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:10,109 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:10,110 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:10,110 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a1c986905b4b75c76cb545a48eca56d5: 2023-02-19 08:00:10,110 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9ece356a26d0f56e3e6639a5ac4967f0, NAME => 'testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:10,110 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 41e4f80f1dcd267361d2089538740658: 2023-02-19 08:00:10,113 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => fc5a61fc9e332779e04d53df613e1587, NAME => 'testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:10,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing dcd361eae0971a2967db576c98a25ff9, disabling compactions & flushes 2023-02-19 08:00:10,141 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:10,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:10,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. after waiting 0 ms 2023-02-19 08:00:10,141 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:10,141 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:10,142 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for dcd361eae0971a2967db576c98a25ff9: 2023-02-19 08:00:10,142 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6cd2c788ffa741e22b829f8fd3df39fa, NAME => 'testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp 2023-02-19 08:00:10,145 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9ece356a26d0f56e3e6639a5ac4967f0, disabling compactions & flushes 2023-02-19 08:00:10,146 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:10,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:10,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. after waiting 0 ms 2023-02-19 08:00:10,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:10,146 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:10,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9ece356a26d0f56e3e6639a5ac4967f0: 2023-02-19 08:00:10,155 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,156 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing fc5a61fc9e332779e04d53df613e1587, disabling compactions & flushes 2023-02-19 08:00:10,156 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:10,156 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:10,157 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. after waiting 0 ms 2023-02-19 08:00:10,157 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:10,157 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:10,157 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for fc5a61fc9e332779e04d53df613e1587: 2023-02-19 08:00:10,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 6cd2c788ffa741e22b829f8fd3df39fa, disabling compactions & flushes 2023-02-19 08:00:10,166 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:10,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:10,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. after waiting 0 ms 2023-02-19 08:00:10,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:10,166 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:10,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 6cd2c788ffa741e22b829f8fd3df39fa: 2023-02-19 08:00:10,172 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:10,174 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793610173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793610173"}]},"ts":"1676793610173"} 2023-02-19 08:00:10,174 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676793609932.12f858663eed44690e97863779d6c54b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793610173"}]},"ts":"1676793610173"} 2023-02-19 08:00:10,174 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793610173"}]},"ts":"1676793610173"} 2023-02-19 08:00:10,174 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676793609932.377808f4fc665932de9d53239fd64839.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793610173"}]},"ts":"1676793610173"} 2023-02-19 08:00:10,174 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793610173"}]},"ts":"1676793610173"} 2023-02-19 08:00:10,174 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793610173"}]},"ts":"1676793610173"} 2023-02-19 08:00:10,175 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793610173"}]},"ts":"1676793610173"} 2023-02-19 08:00:10,175 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793610173"}]},"ts":"1676793610173"} 2023-02-19 08:00:10,175 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793610173"}]},"ts":"1676793610173"} 2023-02-19 08:00:10,175 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793610173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793610173"}]},"ts":"1676793610173"} 2023-02-19 08:00:10,229 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-19 08:00:10,231 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:10,232 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793610232"}]},"ts":"1676793610232"} 2023-02-19 08:00:10,234 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-19 08:00:10,239 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:10,252 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:10,252 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:10,252 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:10,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=735a3357f6a3e4596852ead7c0349d64, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=10266b2fcaa6ab45dac12ab3031b14e6, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=12f858663eed44690e97863779d6c54b, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=41e4f80f1dcd267361d2089538740658, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a1c986905b4b75c76cb545a48eca56d5, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=377808f4fc665932de9d53239fd64839, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dcd361eae0971a2967db576c98a25ff9, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9ece356a26d0f56e3e6639a5ac4967f0, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fc5a61fc9e332779e04d53df613e1587, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6cd2c788ffa741e22b829f8fd3df39fa, ASSIGN}] 2023-02-19 08:00:10,257 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=12f858663eed44690e97863779d6c54b, ASSIGN 2023-02-19 08:00:10,257 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=41e4f80f1dcd267361d2089538740658, ASSIGN 2023-02-19 08:00:10,257 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=10266b2fcaa6ab45dac12ab3031b14e6, ASSIGN 2023-02-19 08:00:10,257 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=735a3357f6a3e4596852ead7c0349d64, ASSIGN 2023-02-19 08:00:10,259 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=41e4f80f1dcd267361d2089538740658, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43525,1676793605916; forceNewPlan=false, retain=false 2023-02-19 08:00:10,259 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=12f858663eed44690e97863779d6c54b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43525,1676793605916; forceNewPlan=false, retain=false 2023-02-19 08:00:10,259 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=10266b2fcaa6ab45dac12ab3031b14e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35991,1676793605965; forceNewPlan=false, retain=false 2023-02-19 08:00:10,259 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=735a3357f6a3e4596852ead7c0349d64, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35991,1676793605965; forceNewPlan=false, retain=false 2023-02-19 08:00:10,259 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6cd2c788ffa741e22b829f8fd3df39fa, ASSIGN 2023-02-19 08:00:10,260 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fc5a61fc9e332779e04d53df613e1587, ASSIGN 2023-02-19 08:00:10,261 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dcd361eae0971a2967db576c98a25ff9, ASSIGN 2023-02-19 08:00:10,261 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6cd2c788ffa741e22b829f8fd3df39fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43525,1676793605916; forceNewPlan=false, retain=false 2023-02-19 08:00:10,261 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9ece356a26d0f56e3e6639a5ac4967f0, ASSIGN 2023-02-19 08:00:10,261 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=377808f4fc665932de9d53239fd64839, ASSIGN 2023-02-19 08:00:10,262 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fc5a61fc9e332779e04d53df613e1587, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35991,1676793605965; forceNewPlan=false, retain=false 2023-02-19 08:00:10,262 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dcd361eae0971a2967db576c98a25ff9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35991,1676793605965; forceNewPlan=false, retain=false 2023-02-19 08:00:10,262 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a1c986905b4b75c76cb545a48eca56d5, ASSIGN 2023-02-19 08:00:10,263 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9ece356a26d0f56e3e6639a5ac4967f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43525,1676793605916; forceNewPlan=false, retain=false 2023-02-19 08:00:10,263 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=377808f4fc665932de9d53239fd64839, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43525,1676793605916; forceNewPlan=false, retain=false 2023-02-19 08:00:10,267 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a1c986905b4b75c76cb545a48eca56d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35991,1676793605965; forceNewPlan=false, retain=false 2023-02-19 08:00:10,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:10,409 INFO [jenkins-hbase4:32887] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-19 08:00:10,413 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9ece356a26d0f56e3e6639a5ac4967f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:10,413 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=377808f4fc665932de9d53239fd64839, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:10,413 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610413"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793610413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793610413"}]},"ts":"1676793610413"} 2023-02-19 08:00:10,413 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676793609932.377808f4fc665932de9d53239fd64839.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610413"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793610413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793610413"}]},"ts":"1676793610413"} 2023-02-19 08:00:10,414 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=41e4f80f1dcd267361d2089538740658, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:10,414 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610414"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793610414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793610414"}]},"ts":"1676793610414"} 2023-02-19 08:00:10,414 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=6cd2c788ffa741e22b829f8fd3df39fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:10,414 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=12f858663eed44690e97863779d6c54b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:10,414 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793610414"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793610414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793610414"}]},"ts":"1676793610414"} 2023-02-19 08:00:10,414 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676793609932.12f858663eed44690e97863779d6c54b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610414"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793610414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793610414"}]},"ts":"1676793610414"} 2023-02-19 08:00:10,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure 9ece356a26d0f56e3e6639a5ac4967f0, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:10,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 377808f4fc665932de9d53239fd64839, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:10,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=14, state=RUNNABLE; OpenRegionProcedure 41e4f80f1dcd267361d2089538740658, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:10,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure 6cd2c788ffa741e22b829f8fd3df39fa, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:10,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure 12f858663eed44690e97863779d6c54b, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:10,425 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=fc5a61fc9e332779e04d53df613e1587, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,425 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793610425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793610425"}]},"ts":"1676793610425"} 2023-02-19 08:00:10,430 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=10266b2fcaa6ab45dac12ab3031b14e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,431 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793610430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793610430"}]},"ts":"1676793610430"} 2023-02-19 08:00:10,432 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a1c986905b4b75c76cb545a48eca56d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,432 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793610432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793610432"}]},"ts":"1676793610432"} 2023-02-19 08:00:10,433 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=dcd361eae0971a2967db576c98a25ff9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,433 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793610433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793610433"}]},"ts":"1676793610433"} 2023-02-19 08:00:10,433 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=735a3357f6a3e4596852ead7c0349d64, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,434 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793610433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793610433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793610433"}]},"ts":"1676793610433"} 2023-02-19 08:00:10,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure fc5a61fc9e332779e04d53df613e1587, server=jenkins-hbase4.apache.org,35991,1676793605965}] 2023-02-19 08:00:10,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure 10266b2fcaa6ab45dac12ab3031b14e6, server=jenkins-hbase4.apache.org,35991,1676793605965}] 2023-02-19 08:00:10,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=15, state=RUNNABLE; OpenRegionProcedure a1c986905b4b75c76cb545a48eca56d5, server=jenkins-hbase4.apache.org,35991,1676793605965}] 2023-02-19 08:00:10,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=17, state=RUNNABLE; OpenRegionProcedure dcd361eae0971a2967db576c98a25ff9, server=jenkins-hbase4.apache.org,35991,1676793605965}] 2023-02-19 08:00:10,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 735a3357f6a3e4596852ead7c0349d64, server=jenkins-hbase4.apache.org,35991,1676793605965}] 2023-02-19 08:00:10,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:10,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 41e4f80f1dcd267361d2089538740658, NAME => 'testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-19 08:00:10,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:10,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:10,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:10,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:10,581 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:10,583 DEBUG [StoreOpener-41e4f80f1dcd267361d2089538740658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1 2023-02-19 08:00:10,583 DEBUG [StoreOpener-41e4f80f1dcd267361d2089538740658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1 2023-02-19 08:00:10,584 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41e4f80f1dcd267361d2089538740658 columnFamilyName f1 2023-02-19 08:00:10,587 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,588 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:10,593 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43554, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:10,594 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] regionserver.HStore(310): Store=41e4f80f1dcd267361d2089538740658/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,594 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:10,597 DEBUG [StoreOpener-41e4f80f1dcd267361d2089538740658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2 2023-02-19 08:00:10,597 DEBUG [StoreOpener-41e4f80f1dcd267361d2089538740658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2 2023-02-19 08:00:10,597 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41e4f80f1dcd267361d2089538740658 columnFamilyName f2 2023-02-19 08:00:10,598 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] regionserver.HStore(310): Store=41e4f80f1dcd267361d2089538740658/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:10,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 10266b2fcaa6ab45dac12ab3031b14e6, NAME => 'testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-19 08:00:10,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:10,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:10,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:10,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:10,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:10,603 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:10,606 DEBUG [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1 2023-02-19 08:00:10,606 DEBUG [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1 2023-02-19 08:00:10,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:10,606 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10266b2fcaa6ab45dac12ab3031b14e6 columnFamilyName f1 2023-02-19 08:00:10,607 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] regionserver.HStore(310): Store=10266b2fcaa6ab45dac12ab3031b14e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,607 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:10,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:10,609 DEBUG [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2 2023-02-19 08:00:10,610 DEBUG [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2 2023-02-19 08:00:10,610 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10266b2fcaa6ab45dac12ab3031b14e6 columnFamilyName f2 2023-02-19 08:00:10,611 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] regionserver.HStore(310): Store=10266b2fcaa6ab45dac12ab3031b14e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:10,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:10,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 41e4f80f1dcd267361d2089538740658; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62615246, jitterRate=-0.06696012616157532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:10,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 41e4f80f1dcd267361d2089538740658: 2023-02-19 08:00:10,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:10,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658., pid=23, masterSystemTime=1676793610571 2023-02-19 08:00:10,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:10,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:10,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:10,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:10,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9ece356a26d0f56e3e6639a5ac4967f0, NAME => 'testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-19 08:00:10,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:10,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,619 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=41e4f80f1dcd267361d2089538740658, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:10,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:10,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:10,620 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610619"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793610619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793610619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793610619"}]},"ts":"1676793610619"} 2023-02-19 08:00:10,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:10,622 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:10,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:10,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 10266b2fcaa6ab45dac12ab3031b14e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72611411, jitterRate=0.08199433982372284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:10,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 10266b2fcaa6ab45dac12ab3031b14e6: 2023-02-19 08:00:10,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6., pid=27, masterSystemTime=1676793610587 2023-02-19 08:00:10,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=14 2023-02-19 08:00:10,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=14, state=SUCCESS; OpenRegionProcedure 41e4f80f1dcd267361d2089538740658, server=jenkins-hbase4.apache.org,43525,1676793605916 in 202 msec 2023-02-19 08:00:10,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:10,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:10,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:10,644 DEBUG [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1 2023-02-19 08:00:10,644 DEBUG [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1 2023-02-19 08:00:10,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a1c986905b4b75c76cb545a48eca56d5, NAME => 'testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-19 08:00:10,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:10,645 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=10266b2fcaa6ab45dac12ab3031b14e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,645 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ece356a26d0f56e3e6639a5ac4967f0 columnFamilyName f1 2023-02-19 08:00:10,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:10,645 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610645"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793610645"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793610645"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793610645"}]},"ts":"1676793610645"} 2023-02-19 08:00:10,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:10,649 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] regionserver.HStore(310): Store=9ece356a26d0f56e3e6639a5ac4967f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,649 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:10,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=41e4f80f1dcd267361d2089538740658, ASSIGN in 390 msec 2023-02-19 08:00:10,651 DEBUG [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2 2023-02-19 08:00:10,652 DEBUG [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2 2023-02-19 08:00:10,652 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:10,652 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ece356a26d0f56e3e6639a5ac4967f0 columnFamilyName f2 2023-02-19 08:00:10,655 DEBUG [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1 2023-02-19 08:00:10,655 DEBUG [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1 2023-02-19 08:00:10,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-19 08:00:10,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure 10266b2fcaa6ab45dac12ab3031b14e6, server=jenkins-hbase4.apache.org,35991,1676793605965 in 215 msec 2023-02-19 08:00:10,656 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1c986905b4b75c76cb545a48eca56d5 columnFamilyName f1 2023-02-19 08:00:10,656 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] regionserver.HStore(310): Store=9ece356a26d0f56e3e6639a5ac4967f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:10,661 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] regionserver.HStore(310): Store=a1c986905b4b75c76cb545a48eca56d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,661 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:10,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:10,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=10266b2fcaa6ab45dac12ab3031b14e6, ASSIGN in 403 msec 2023-02-19 08:00:10,664 DEBUG [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2 2023-02-19 08:00:10,664 DEBUG [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2 2023-02-19 08:00:10,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:10,665 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1c986905b4b75c76cb545a48eca56d5 columnFamilyName f2 2023-02-19 08:00:10,667 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] regionserver.HStore(310): Store=a1c986905b4b75c76cb545a48eca56d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:10,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:10,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:10,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:10,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9ece356a26d0f56e3e6639a5ac4967f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69551664, jitterRate=0.036400556564331055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:10,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9ece356a26d0f56e3e6639a5ac4967f0: 2023-02-19 08:00:10,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:10,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0., pid=21, masterSystemTime=1676793610571 2023-02-19 08:00:10,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:10,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:10,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:10,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:10,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 377808f4fc665932de9d53239fd64839, NAME => 'testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-19 08:00:10,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:10,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:10,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:10,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9ece356a26d0f56e3e6639a5ac4967f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:10,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610680"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793610680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793610680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793610680"}]},"ts":"1676793610680"} 2023-02-19 08:00:10,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:10,681 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:10,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a1c986905b4b75c76cb545a48eca56d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72196473, jitterRate=0.07581128180027008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:10,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a1c986905b4b75c76cb545a48eca56d5: 2023-02-19 08:00:10,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5., pid=28, masterSystemTime=1676793610587 2023-02-19 08:00:10,684 DEBUG [StoreOpener-377808f4fc665932de9d53239fd64839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1 2023-02-19 08:00:10,684 DEBUG [StoreOpener-377808f4fc665932de9d53239fd64839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1 2023-02-19 08:00:10,685 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 377808f4fc665932de9d53239fd64839 columnFamilyName f1 2023-02-19 08:00:10,686 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] regionserver.HStore(310): Store=377808f4fc665932de9d53239fd64839/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,686 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:10,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:10,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:10,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:10,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dcd361eae0971a2967db576c98a25ff9, NAME => 'testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-19 08:00:10,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:10,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-19 08:00:10,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:10,688 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a1c986905b4b75c76cb545a48eca56d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure 9ece356a26d0f56e3e6639a5ac4967f0, server=jenkins-hbase4.apache.org,43525,1676793605916 in 266 msec 2023-02-19 08:00:10,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:10,688 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793610688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793610688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793610688"}]},"ts":"1676793610688"} 2023-02-19 08:00:10,690 DEBUG [StoreOpener-377808f4fc665932de9d53239fd64839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2 2023-02-19 08:00:10,690 DEBUG [StoreOpener-377808f4fc665932de9d53239fd64839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2 2023-02-19 08:00:10,690 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 377808f4fc665932de9d53239fd64839 columnFamilyName f2 2023-02-19 08:00:10,691 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] regionserver.HStore(310): Store=377808f4fc665932de9d53239fd64839/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9ece356a26d0f56e3e6639a5ac4967f0, ASSIGN in 435 msec 2023-02-19 08:00:10,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839 2023-02-19 08:00:10,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839 2023-02-19 08:00:10,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=15 2023-02-19 08:00:10,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:10,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=15, state=SUCCESS; OpenRegionProcedure a1c986905b4b75c76cb545a48eca56d5, server=jenkins-hbase4.apache.org,35991,1676793605965 in 255 msec 2023-02-19 08:00:10,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:10,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a1c986905b4b75c76cb545a48eca56d5, ASSIGN in 445 msec 2023-02-19 08:00:10,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:10,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 377808f4fc665932de9d53239fd64839; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60669420, jitterRate=-0.09595519304275513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:10,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 377808f4fc665932de9d53239fd64839: 2023-02-19 08:00:10,705 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:10,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839., pid=22, masterSystemTime=1676793610571 2023-02-19 08:00:10,707 DEBUG [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1 2023-02-19 08:00:10,707 DEBUG [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1 2023-02-19 08:00:10,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:10,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:10,708 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dcd361eae0971a2967db576c98a25ff9 columnFamilyName f1 2023-02-19 08:00:10,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:10,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6cd2c788ffa741e22b829f8fd3df39fa, NAME => 'testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-19 08:00:10,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:10,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,709 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=377808f4fc665932de9d53239fd64839, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:10,710 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] regionserver.HStore(310): Store=dcd361eae0971a2967db576c98a25ff9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:10,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:10,710 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:10,710 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676793609932.377808f4fc665932de9d53239fd64839.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610709"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793610709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793610709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793610709"}]},"ts":"1676793610709"} 2023-02-19 08:00:10,712 DEBUG [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2 2023-02-19 08:00:10,712 DEBUG [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2 2023-02-19 08:00:10,713 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dcd361eae0971a2967db576c98a25ff9 columnFamilyName f2 2023-02-19 08:00:10,713 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] regionserver.HStore(310): Store=dcd361eae0971a2967db576c98a25ff9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,716 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:10,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:10,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-19 08:00:10,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 377808f4fc665932de9d53239fd64839, server=jenkins-hbase4.apache.org,43525,1676793605916 in 294 msec 2023-02-19 08:00:10,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:10,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=377808f4fc665932de9d53239fd64839, ASSIGN in 464 msec 2023-02-19 08:00:10,720 DEBUG [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/f1 2023-02-19 08:00:10,720 DEBUG [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/f1 2023-02-19 08:00:10,720 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cd2c788ffa741e22b829f8fd3df39fa columnFamilyName f1 2023-02-19 08:00:10,721 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] regionserver.HStore(310): Store=6cd2c788ffa741e22b829f8fd3df39fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,721 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:10,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:10,724 DEBUG [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/f2 2023-02-19 08:00:10,724 DEBUG [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/f2 2023-02-19 08:00:10,725 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cd2c788ffa741e22b829f8fd3df39fa columnFamilyName f2 2023-02-19 08:00:10,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:10,725 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] regionserver.HStore(310): Store=6cd2c788ffa741e22b829f8fd3df39fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:10,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:10,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:10,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:10,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:10,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dcd361eae0971a2967db576c98a25ff9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59838216, jitterRate=-0.10834109783172607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:10,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:10,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dcd361eae0971a2967db576c98a25ff9: 2023-02-19 08:00:10,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6cd2c788ffa741e22b829f8fd3df39fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69793855, jitterRate=0.04000948369503021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:10,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6cd2c788ffa741e22b829f8fd3df39fa: 2023-02-19 08:00:10,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9., pid=29, masterSystemTime=1676793610587 2023-02-19 08:00:10,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa., pid=24, masterSystemTime=1676793610571 2023-02-19 08:00:10,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:10,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:10,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:10,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 735a3357f6a3e4596852ead7c0349d64, NAME => 'testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-19 08:00:10,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:10,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:10,750 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=dcd361eae0971a2967db576c98a25ff9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:10,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,751 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793610750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793610750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793610750"}]},"ts":"1676793610750"} 2023-02-19 08:00:10,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:10,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:10,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:10,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12f858663eed44690e97863779d6c54b, NAME => 'testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-19 08:00:10,752 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=6cd2c788ffa741e22b829f8fd3df39fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:10,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:10,753 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793610752"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793610752"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793610752"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793610752"}]},"ts":"1676793610752"} 2023-02-19 08:00:10,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:10,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:10,755 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:10,756 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:10,759 DEBUG [StoreOpener-12f858663eed44690e97863779d6c54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1 2023-02-19 08:00:10,759 DEBUG [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/f1 2023-02-19 08:00:10,759 DEBUG [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/f1 2023-02-19 08:00:10,759 DEBUG [StoreOpener-12f858663eed44690e97863779d6c54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1 2023-02-19 08:00:10,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=17 2023-02-19 08:00:10,761 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 735a3357f6a3e4596852ead7c0349d64 columnFamilyName f1 2023-02-19 08:00:10,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=17, state=SUCCESS; OpenRegionProcedure dcd361eae0971a2967db576c98a25ff9, server=jenkins-hbase4.apache.org,35991,1676793605965 in 315 msec 2023-02-19 08:00:10,761 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12f858663eed44690e97863779d6c54b columnFamilyName f1 2023-02-19 08:00:10,762 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] regionserver.HStore(310): Store=735a3357f6a3e4596852ead7c0349d64/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,762 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] regionserver.HStore(310): Store=12f858663eed44690e97863779d6c54b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,762 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:10,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-19 08:00:10,762 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:10,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure 6cd2c788ffa741e22b829f8fd3df39fa, server=jenkins-hbase4.apache.org,43525,1676793605916 in 335 msec 2023-02-19 08:00:10,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dcd361eae0971a2967db576c98a25ff9, ASSIGN in 508 msec 2023-02-19 08:00:10,764 DEBUG [StoreOpener-12f858663eed44690e97863779d6c54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2 2023-02-19 08:00:10,764 DEBUG [StoreOpener-12f858663eed44690e97863779d6c54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2 2023-02-19 08:00:10,764 DEBUG [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/f2 2023-02-19 08:00:10,765 DEBUG [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/f2 2023-02-19 08:00:10,765 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6cd2c788ffa741e22b829f8fd3df39fa, ASSIGN in 509 msec 2023-02-19 08:00:10,765 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12f858663eed44690e97863779d6c54b columnFamilyName f2 2023-02-19 08:00:10,765 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 735a3357f6a3e4596852ead7c0349d64 columnFamilyName f2 2023-02-19 08:00:10,766 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] regionserver.HStore(310): Store=12f858663eed44690e97863779d6c54b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,766 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] regionserver.HStore(310): Store=735a3357f6a3e4596852ead7c0349d64/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b 2023-02-19 08:00:10,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:10,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b 2023-02-19 08:00:10,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:10,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:10,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:10,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:10,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:10,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:10,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:10,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 12f858663eed44690e97863779d6c54b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63711592, jitterRate=-0.050623297691345215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:10,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 12f858663eed44690e97863779d6c54b: 2023-02-19 08:00:10,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 735a3357f6a3e4596852ead7c0349d64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72386977, jitterRate=0.07865001261234283}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:10,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 735a3357f6a3e4596852ead7c0349d64: 2023-02-19 08:00:10,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b., pid=25, masterSystemTime=1676793610571 2023-02-19 08:00:10,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64., pid=30, masterSystemTime=1676793610587 2023-02-19 08:00:10,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:10,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:10,784 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=12f858663eed44690e97863779d6c54b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:10,784 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676793609932.12f858663eed44690e97863779d6c54b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610784"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793610784"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793610784"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793610784"}]},"ts":"1676793610784"} 2023-02-19 08:00:10,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:10,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:10,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:10,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fc5a61fc9e332779e04d53df613e1587, NAME => 'testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-19 08:00:10,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:10,785 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=735a3357f6a3e4596852ead7c0349d64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:10,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:10,786 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793610785"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793610785"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793610785"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793610785"}]},"ts":"1676793610785"} 2023-02-19 08:00:10,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:10,788 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:10,791 DEBUG [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1 2023-02-19 08:00:10,791 DEBUG [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1 2023-02-19 08:00:10,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-19 08:00:10,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure 12f858663eed44690e97863779d6c54b, server=jenkins-hbase4.apache.org,43525,1676793605916 in 363 msec 2023-02-19 08:00:10,791 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc5a61fc9e332779e04d53df613e1587 columnFamilyName f1 2023-02-19 08:00:10,792 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] regionserver.HStore(310): Store=fc5a61fc9e332779e04d53df613e1587/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-19 08:00:10,792 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:10,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 735a3357f6a3e4596852ead7c0349d64, server=jenkins-hbase4.apache.org,35991,1676793605965 in 346 msec 2023-02-19 08:00:10,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=12f858663eed44690e97863779d6c54b, ASSIGN in 538 msec 2023-02-19 08:00:10,794 DEBUG [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2 2023-02-19 08:00:10,794 DEBUG [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2 2023-02-19 08:00:10,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=735a3357f6a3e4596852ead7c0349d64, ASSIGN in 539 msec 2023-02-19 08:00:10,795 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc5a61fc9e332779e04d53df613e1587 columnFamilyName f2 2023-02-19 08:00:10,796 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] regionserver.HStore(310): Store=fc5a61fc9e332779e04d53df613e1587/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:10,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:10,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:10,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:10,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:10,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:10,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fc5a61fc9e332779e04d53df613e1587; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72253087, jitterRate=0.07665489614009857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:10,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fc5a61fc9e332779e04d53df613e1587: 2023-02-19 08:00:10,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587., pid=26, masterSystemTime=1676793610587 2023-02-19 08:00:10,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:10,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:10,810 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=fc5a61fc9e332779e04d53df613e1587, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:10,811 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793610810"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793610810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793610810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793610810"}]},"ts":"1676793610810"} 2023-02-19 08:00:10,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-19 08:00:10,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure fc5a61fc9e332779e04d53df613e1587, server=jenkins-hbase4.apache.org,35991,1676793605965 in 380 msec 2023-02-19 08:00:10,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-19 08:00:10,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fc5a61fc9e332779e04d53df613e1587, ASSIGN in 564 msec 2023-02-19 08:00:10,825 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:10,825 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793610825"}]},"ts":"1676793610825"} 2023-02-19 08:00:10,828 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-19 08:00:10,831 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:10,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 894 msec 2023-02-19 08:00:11,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:11,085 INFO [Listener at localhost/37093] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-19 08:00:11,085 DEBUG [Listener at localhost/37093] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-19 08:00:11,087 INFO [Listener at localhost/37093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:11,097 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-19 08:00:11,098 INFO [Listener at localhost/37093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:11,098 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-19 08:00:11,098 INFO [Listener at localhost/37093] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 08:00:11,243 DEBUG [hconnection-0x7255a7db-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:11,301 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43562, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:11,319 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43525] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:11,337 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35991] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:11,617 INFO [Listener at localhost/37093] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 08:00:11,622 INFO [Listener at localhost/37093] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 08:00:11,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 08:00:11,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676793611636 (current time:1676793611636). 2023-02-19 08:00:11,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 08:00:11,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] zookeeper.ReadOnlyZKClient(139): Connect 0x4c843e0b to 127.0.0.1:57971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:11,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b2262c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:11,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:11,654 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40260, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:11,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c843e0b to 127.0.0.1:57971 2023-02-19 08:00:11,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:11,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 08:00:11,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 08:00:11,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 08:00:11,687 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 08:00:11,689 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676794211689 2023-02-19 08:00:11,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 08:00:11,690 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-19 08:00:11,692 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 08:00:11,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 08:00:11,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 16 msec 2023-02-19 08:00:11,697 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 08:00:11,697 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:11,697 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 08:00:11,698 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676794211698 2023-02-19 08:00:11,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-19 08:00:11,746 INFO [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-19 08:00:11,746 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:11,747 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-19 08:00:11,747 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-19 08:00:11,748 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:11,748 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 08:00:11,751 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:11,751 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:11,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:11,751 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:11,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:11,751 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 08:00:11,752 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 08:00:11,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:11,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:11,752 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:11,752 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-19 08:00:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 08:00:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-19 08:00:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 08:00:11,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 08:00:11,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 08:00:11,756 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-19 08:00:11,756 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-19 08:00:11,756 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-19 08:00:11,756 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-19 08:00:11,756 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:11,756 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:11,757 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 08:00:11,757 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 08:00:11,757 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-19 08:00:11,757 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-19 08:00:11,757 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35991,1676793605965' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-19 08:00:11,757 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43525,1676793605916' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-19 08:00:11,760 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,760 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:11,761 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,761 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:11,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:11,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:11,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 08:00:11,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:11,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:11,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35991,1676793605965' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-19 08:00:11,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50ca73dc[Count = 1] remaining members to acquire global barrier 2023-02-19 08:00:11,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:11,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:11,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:11,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:11,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:11,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 08:00:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:11,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43525,1676793605916' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-19 08:00:11,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50ca73dc[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:11,768 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-19 08:00:11,768 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,770 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,770 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:11,770 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 08:00:11,770 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 08:00:11,770 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:11,771 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:11,771 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:11,771 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:11,771 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:11,771 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:11,772 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:11,771 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:11,772 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. started... 2023-02-19 08:00:11,772 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. started... 2023-02-19 08:00:11,772 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. started... 2023-02-19 08:00:11,772 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 08:00:11,772 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. started... 2023-02-19 08:00:11,772 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. started... 2023-02-19 08:00:11,771 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 08:00:11,772 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 08:00:11,772 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 08:00:11,772 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:11,773 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. started... 2023-02-19 08:00:11,780 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 41e4f80f1dcd267361d2089538740658 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:11,780 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 377808f4fc665932de9d53239fd64839 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:11,780 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HRegion(2744): Flushing dcd361eae0971a2967db576c98a25ff9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:11,781 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6cd2c788ffa741e22b829f8fd3df39fa: 2023-02-19 08:00:11,783 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:11,788 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:11,788 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a1c986905b4b75c76cb545a48eca56d5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:11,789 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 735a3357f6a3e4596852ead7c0349d64: 2023-02-19 08:00:11,789 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:11,789 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:11,794 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:11,794 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:11,794 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:11,795 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:11,797 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:11,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:11,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:11,803 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 08:00:11,823 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. completed. 2023-02-19 08:00:11,823 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:11,825 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:11,825 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 08:00:11,825 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. started... 2023-02-19 08:00:11,826 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 12f858663eed44690e97863779d6c54b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:11,826 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. completed. 2023-02-19 08:00:11,827 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:11,827 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:11,827 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 08:00:11,827 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. started... 2023-02-19 08:00:11,830 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] regionserver.HRegion(2744): Flushing fc5a61fc9e332779e04d53df613e1587 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 08:00:12,003 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:12,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:12,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:12,005 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-19 08:00:12,034 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/.tmp/f1/18e6b8d942624617831facd8c49b9f18 2023-02-19 08:00:12,040 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/.tmp/f1/61dd81b3cd4c4ce882df917e5dde87e1 2023-02-19 08:00:12,041 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/.tmp/f1/59d06bd46d2545bbafad43484714e879 2023-02-19 08:00:12,047 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/.tmp/f1/bc8f887456d4466bb869e459fcf87115 2023-02-19 08:00:12,055 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/.tmp/f1/79331457b80f40eb8b250226197da8b3 2023-02-19 08:00:12,197 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/.tmp/f2/207880324d71460a87aaea027bd14242 2023-02-19 08:00:12,213 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/.tmp/f1/bc8f887456d4466bb869e459fcf87115 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/bc8f887456d4466bb869e459fcf87115 2023-02-19 08:00:12,227 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/bc8f887456d4466bb869e459fcf87115, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,227 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/.tmp/f2/381e109adfd64ecba07d8a593628ed63 2023-02-19 08:00:12,230 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/.tmp/f2/e561d1145e4449be99a229b16a7ed145 2023-02-19 08:00:12,234 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/.tmp/f2/207880324d71460a87aaea027bd14242 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/207880324d71460a87aaea027bd14242 2023-02-19 08:00:12,241 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/.tmp/f1/18e6b8d942624617831facd8c49b9f18 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/18e6b8d942624617831facd8c49b9f18 2023-02-19 08:00:12,241 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/.tmp/f1/59d06bd46d2545bbafad43484714e879 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/59d06bd46d2545bbafad43484714e879 2023-02-19 08:00:12,248 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/207880324d71460a87aaea027bd14242, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,249 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 377808f4fc665932de9d53239fd64839 in 470ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:12,250 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/18e6b8d942624617831facd8c49b9f18, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,252 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/59d06bd46d2545bbafad43484714e879, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,252 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-19 08:00:12,252 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/.tmp/f2/381e109adfd64ecba07d8a593628ed63 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/381e109adfd64ecba07d8a593628ed63 2023-02-19 08:00:12,253 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/.tmp/f2/e561d1145e4449be99a229b16a7ed145 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/e561d1145e4449be99a229b16a7ed145 2023-02-19 08:00:12,253 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 377808f4fc665932de9d53239fd64839: 2023-02-19 08:00:12,254 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,254 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:12,254 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/bc8f887456d4466bb869e459fcf87115] hfiles 2023-02-19 08:00:12,254 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/bc8f887456d4466bb869e459fcf87115 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,258 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/207880324d71460a87aaea027bd14242] hfiles 2023-02-19 08:00:12,258 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/207880324d71460a87aaea027bd14242 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,261 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/381e109adfd64ecba07d8a593628ed63, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,263 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/e561d1145e4449be99a229b16a7ed145, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,263 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a1c986905b4b75c76cb545a48eca56d5 in 475ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:12,264 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a1c986905b4b75c76cb545a48eca56d5: 2023-02-19 08:00:12,264 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,265 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:12,265 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/18e6b8d942624617831facd8c49b9f18] hfiles 2023-02-19 08:00:12,265 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/18e6b8d942624617831facd8c49b9f18 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,265 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/381e109adfd64ecba07d8a593628ed63] hfiles 2023-02-19 08:00:12,265 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/381e109adfd64ecba07d8a593628ed63 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,265 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for dcd361eae0971a2967db576c98a25ff9 in 485ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:12,265 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for dcd361eae0971a2967db576c98a25ff9: 2023-02-19 08:00:12,266 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,266 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:12,266 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/59d06bd46d2545bbafad43484714e879] hfiles 2023-02-19 08:00:12,266 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/59d06bd46d2545bbafad43484714e879 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,266 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/e561d1145e4449be99a229b16a7ed145] hfiles 2023-02-19 08:00:12,266 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/e561d1145e4449be99a229b16a7ed145 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,279 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. completed. 2023-02-19 08:00:12,279 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:12,279 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:12,279 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 08:00:12,279 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. started... 2023-02-19 08:00:12,281 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9ece356a26d0f56e3e6639a5ac4967f0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:12,283 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. completed. 2023-02-19 08:00:12,283 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:12,283 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 08:00:12,283 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:12,283 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. started... 2023-02-19 08:00:12,284 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 10266b2fcaa6ab45dac12ab3031b14e6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 08:00:12,285 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. completed. 2023-02-19 08:00:12,286 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:12,286 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 08:00:12,305 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:12,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:12,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:12,308 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-19 08:00:12,344 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/.tmp/f1/133ee053b18c40588fc7bcb0b6b3ff7f 2023-02-19 08:00:12,351 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/.tmp/f1/44b34a072fe145bba304be71ba6b78f4 2023-02-19 08:00:12,394 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/.tmp/f2/6685626747c24ba0935e286bc59453c4 2023-02-19 08:00:12,398 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/.tmp/f2/0f9a999f018f45b792da442beb18ad82 2023-02-19 08:00:12,402 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/.tmp/f1/133ee053b18c40588fc7bcb0b6b3ff7f as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/133ee053b18c40588fc7bcb0b6b3ff7f 2023-02-19 08:00:12,406 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/.tmp/f1/44b34a072fe145bba304be71ba6b78f4 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/44b34a072fe145bba304be71ba6b78f4 2023-02-19 08:00:12,410 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/133ee053b18c40588fc7bcb0b6b3ff7f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:12,412 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/.tmp/f2/6685626747c24ba0935e286bc59453c4 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/6685626747c24ba0935e286bc59453c4 2023-02-19 08:00:12,415 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/44b34a072fe145bba304be71ba6b78f4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,416 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/.tmp/f2/0f9a999f018f45b792da442beb18ad82 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/0f9a999f018f45b792da442beb18ad82 2023-02-19 08:00:12,422 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/6685626747c24ba0935e286bc59453c4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:12,423 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 10266b2fcaa6ab45dac12ab3031b14e6 in 139ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:12,423 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 10266b2fcaa6ab45dac12ab3031b14e6: 2023-02-19 08:00:12,424 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,424 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:12,424 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/133ee053b18c40588fc7bcb0b6b3ff7f] hfiles 2023-02-19 08:00:12,424 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/133ee053b18c40588fc7bcb0b6b3ff7f for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,424 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/6685626747c24ba0935e286bc59453c4] hfiles 2023-02-19 08:00:12,424 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/6685626747c24ba0935e286bc59453c4 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,425 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/0f9a999f018f45b792da442beb18ad82, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,426 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9ece356a26d0f56e3e6639a5ac4967f0 in 145ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:12,426 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9ece356a26d0f56e3e6639a5ac4967f0: 2023-02-19 08:00:12,426 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,426 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:12,426 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/44b34a072fe145bba304be71ba6b78f4] hfiles 2023-02-19 08:00:12,426 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/44b34a072fe145bba304be71ba6b78f4 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,427 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/0f9a999f018f45b792da442beb18ad82] hfiles 2023-02-19 08:00:12,427 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/0f9a999f018f45b792da442beb18ad82 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,449 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/.tmp/f1/cdf321db773f4b868e912dad1123b0be 2023-02-19 08:00:12,473 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. completed. 2023-02-19 08:00:12,473 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:12,473 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 08:00:12,480 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. completed. 2023-02-19 08:00:12,480 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:12,480 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 08:00:12,508 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/.tmp/f2/d0e31808382c4096b884a70642fde97b 2023-02-19 08:00:12,516 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/.tmp/f1/cdf321db773f4b868e912dad1123b0be as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/cdf321db773f4b868e912dad1123b0be 2023-02-19 08:00:12,523 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/cdf321db773f4b868e912dad1123b0be, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,524 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/.tmp/f2/d0e31808382c4096b884a70642fde97b as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/d0e31808382c4096b884a70642fde97b 2023-02-19 08:00:12,532 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/d0e31808382c4096b884a70642fde97b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,533 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 41e4f80f1dcd267361d2089538740658 in 754ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:12,533 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 41e4f80f1dcd267361d2089538740658: 2023-02-19 08:00:12,533 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,533 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:12,534 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/cdf321db773f4b868e912dad1123b0be] hfiles 2023-02-19 08:00:12,534 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/cdf321db773f4b868e912dad1123b0be for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,534 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/d0e31808382c4096b884a70642fde97b] hfiles 2023-02-19 08:00:12,534 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/d0e31808382c4096b884a70642fde97b for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,549 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. completed. 2023-02-19 08:00:12,549 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:12,550 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 08:00:12,631 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/.tmp/f2/2a4d0831424f46f4a0619f0a7f11b73b 2023-02-19 08:00:12,631 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/.tmp/f2/576213703fda4924bca2a7824214ea00 2023-02-19 08:00:12,640 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/.tmp/f1/61dd81b3cd4c4ce882df917e5dde87e1 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/61dd81b3cd4c4ce882df917e5dde87e1 2023-02-19 08:00:12,646 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/.tmp/f1/79331457b80f40eb8b250226197da8b3 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/79331457b80f40eb8b250226197da8b3 2023-02-19 08:00:12,649 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/61dd81b3cd4c4ce882df917e5dde87e1, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:12,650 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/.tmp/f2/576213703fda4924bca2a7824214ea00 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/576213703fda4924bca2a7824214ea00 2023-02-19 08:00:12,654 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/79331457b80f40eb8b250226197da8b3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,655 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/.tmp/f2/2a4d0831424f46f4a0619f0a7f11b73b as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/2a4d0831424f46f4a0619f0a7f11b73b 2023-02-19 08:00:12,659 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/576213703fda4924bca2a7824214ea00, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:12,661 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for fc5a61fc9e332779e04d53df613e1587 in 832ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:12,661 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for fc5a61fc9e332779e04d53df613e1587: 2023-02-19 08:00:12,661 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,661 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:12,661 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/61dd81b3cd4c4ce882df917e5dde87e1] hfiles 2023-02-19 08:00:12,661 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/61dd81b3cd4c4ce882df917e5dde87e1 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,662 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/576213703fda4924bca2a7824214ea00] hfiles 2023-02-19 08:00:12,662 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/576213703fda4924bca2a7824214ea00 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,667 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/2a4d0831424f46f4a0619f0a7f11b73b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:12,668 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 12f858663eed44690e97863779d6c54b in 842ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:12,668 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 12f858663eed44690e97863779d6c54b: 2023-02-19 08:00:12,668 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,668 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:12,669 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/79331457b80f40eb8b250226197da8b3] hfiles 2023-02-19 08:00:12,669 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/79331457b80f40eb8b250226197da8b3 for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,669 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/2a4d0831424f46f4a0619f0a7f11b73b] hfiles 2023-02-19 08:00:12,669 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/2a4d0831424f46f4a0619f0a7f11b73b for snapshot=testWithMapReduceMultiRegion 2023-02-19 08:00:12,672 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. completed. 2023-02-19 08:00:12,672 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:12,673 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 08:00:12,673 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 08:00:12,673 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,673 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-19 08:00:12,673 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35991,1676793605965' in zk 2023-02-19 08:00:12,677 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,678 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-19 08:00:12,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:12,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:12,678 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:12,678 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-19 08:00:12,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:12,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:12,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 08:00:12,680 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. completed. 2023-02-19 08:00:12,680 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:12,680 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 08:00:12,680 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 08:00:12,681 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,681 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-19 08:00:12,681 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43525,1676793605916' in zk 2023-02-19 08:00:12,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:12,684 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-19 08:00:12,684 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,684 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:12,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 08:00:12,684 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-19 08:00:12,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35991,1676793605965': 2023-02-19 08:00:12,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35991,1676793605965' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 08:00:12,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:12,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:12,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:12,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:12,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 08:00:12,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:12,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 08:00:12,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43525,1676793605916': 2023-02-19 08:00:12,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43525,1676793605916' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 08:00:12,691 INFO [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-19 08:00:12,691 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:12,691 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:12,691 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-19 08:00:12,691 INFO [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 08:00:12,694 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,694 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,694 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:12,694 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:12,694 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:12,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:12,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:12,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:12,695 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:12,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:12,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:12,695 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 08:00:12,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:12,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 08:00:12,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,698 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:12,698 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-19 08:00:12,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,712 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,712 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:12,712 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 08:00:12,712 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,712 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:12,712 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:12,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:12,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:12,712 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:12,712 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-19 08:00:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:12,713 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:12,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:12,713 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:12,713 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-19 08:00:12,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:12,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-19 08:00:12,713 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:12,714 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:12,714 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-19 08:00:12,714 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-19 08:00:12,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:12,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-19 08:00:12,808 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:12,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:12,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:12,810 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-19 08:00:12,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-19 08:00:12,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-19 08:00:12,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-19 08:00:12,852 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-19 08:00:12,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676793611690Consolidate snapshot: testWithMapReduceMultiRegion at 1676793612714 (+1024 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676793612714Writing data manifest for testWithMapReduceMultiRegion at 1676793612739 (+25 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676793612768 (+29 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676793612851 (+83 ms) 2023-02-19 08:00:12,853 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 08:00:12,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1610 sec 2023-02-19 08:00:13,811 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:13,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:13,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 08:00:13,813 INFO [Listener at localhost/37093] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 08:00:13,824 INFO [Listener at localhost/37093] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 08:00:13,834 INFO [Listener at localhost/37093] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 08:00:13,926 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35991] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:13,942 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43525] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:14,086 INFO [Listener at localhost/37093] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 08:00:14,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 08:00:14,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-19 08:00:14,104 INFO [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-19 08:00:14,104 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:14,104 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-19 08:00:14,105 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-19 08:00:14,105 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,105 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:14,106 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:14,106 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:14,107 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:14,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:14,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:14,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:14,107 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,107 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:14,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:14,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,108 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,108 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:14,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:14,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:14,109 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 08:00:14,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 08:00:14,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:14,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:14,111 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 08:00:14,112 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 08:00:14,112 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:14,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 08:00:14,113 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 08:00:14,114 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 08:00:14,114 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:14,114 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 08:00:14,115 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:14,115 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:14,115 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. started... 2023-02-19 08:00:14,115 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. started... 2023-02-19 08:00:14,115 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6cd2c788ffa741e22b829f8fd3df39fa: 2023-02-19 08:00:14,115 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 377808f4fc665932de9d53239fd64839 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:14,115 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:14,116 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:14,116 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. started... 2023-02-19 08:00:14,116 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 08:00:14,116 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 08:00:14,116 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a1c986905b4b75c76cb545a48eca56d5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:14,116 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 08:00:14,117 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:14,119 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:14,118 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:14,124 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. started... 2023-02-19 08:00:14,124 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 08:00:14,124 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing dcd361eae0971a2967db576c98a25ff9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:14,120 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. started... 2023-02-19 08:00:14,124 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 08:00:14,125 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 12f858663eed44690e97863779d6c54b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:14,124 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. started... 2023-02-19 08:00:14,124 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. started... 2023-02-19 08:00:14,125 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 41e4f80f1dcd267361d2089538740658 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:14,126 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 735a3357f6a3e4596852ead7c0349d64: 2023-02-19 08:00:14,126 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:14,126 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:14,126 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 08:00:14,126 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. started... 2023-02-19 08:00:14,126 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fc5a61fc9e332779e04d53df613e1587 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 08:00:14,188 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/.tmp/f1/91cbf249c936421d82c86eac2c624da3 2023-02-19 08:00:14,203 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/.tmp/f1/589b7802680a463fadaba69e43472cd8 2023-02-19 08:00:14,227 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/.tmp/f1/2cc5709fb7634131a85c6a6f4f165241 2023-02-19 08:00:14,228 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/.tmp/f1/920d8324838642b5af55ecda8a22b22e 2023-02-19 08:00:14,239 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/.tmp/f1/8a0508eac763454ebd4ea2a076f117e4 2023-02-19 08:00:14,250 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/.tmp/f2/c1559c16222c4c72b33518b0c0a0c215 2023-02-19 08:00:14,262 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/.tmp/f2/31c163741c694c398259c7c84014edc4 2023-02-19 08:00:14,268 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/.tmp/f1/91cbf249c936421d82c86eac2c624da3 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/91cbf249c936421d82c86eac2c624da3 2023-02-19 08:00:14,272 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/.tmp/f1/589b7802680a463fadaba69e43472cd8 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/589b7802680a463fadaba69e43472cd8 2023-02-19 08:00:14,276 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/91cbf249c936421d82c86eac2c624da3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,276 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/.tmp/f2/97494ed7681846a3b0e4218a3e26e16a 2023-02-19 08:00:14,278 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/.tmp/f2/c1559c16222c4c72b33518b0c0a0c215 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/c1559c16222c4c72b33518b0c0a0c215 2023-02-19 08:00:14,282 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/.tmp/f2/d914a1f88c3f4fd89a07c07f072c3898 2023-02-19 08:00:14,282 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/589b7802680a463fadaba69e43472cd8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,283 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/.tmp/f2/31c163741c694c398259c7c84014edc4 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/31c163741c694c398259c7c84014edc4 2023-02-19 08:00:14,288 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/.tmp/f1/2cc5709fb7634131a85c6a6f4f165241 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/2cc5709fb7634131a85c6a6f4f165241 2023-02-19 08:00:14,291 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/.tmp/f1/8a0508eac763454ebd4ea2a076f117e4 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/8a0508eac763454ebd4ea2a076f117e4 2023-02-19 08:00:14,293 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/31c163741c694c398259c7c84014edc4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,294 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/c1559c16222c4c72b33518b0c0a0c215, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,295 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 41e4f80f1dcd267361d2089538740658 in 170ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:14,295 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 41e4f80f1dcd267361d2089538740658: 2023-02-19 08:00:14,295 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:14,295 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:14,295 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. started... 2023-02-19 08:00:14,295 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9ece356a26d0f56e3e6639a5ac4967f0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:14,295 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 08:00:14,296 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a1c986905b4b75c76cb545a48eca56d5 in 180ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:14,296 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a1c986905b4b75c76cb545a48eca56d5: 2023-02-19 08:00:14,296 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:14,298 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 08:00:14,298 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:14,298 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. started... 2023-02-19 08:00:14,298 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 10266b2fcaa6ab45dac12ab3031b14e6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 08:00:14,302 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/8a0508eac763454ebd4ea2a076f117e4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,303 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/.tmp/f2/d914a1f88c3f4fd89a07c07f072c3898 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/d914a1f88c3f4fd89a07c07f072c3898 2023-02-19 08:00:14,305 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/2cc5709fb7634131a85c6a6f4f165241, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:14,309 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/.tmp/f2/97494ed7681846a3b0e4218a3e26e16a as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/97494ed7681846a3b0e4218a3e26e16a 2023-02-19 08:00:14,324 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/97494ed7681846a3b0e4218a3e26e16a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:14,324 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/d914a1f88c3f4fd89a07c07f072c3898, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,325 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 12f858663eed44690e97863779d6c54b in 200ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:14,325 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for fc5a61fc9e332779e04d53df613e1587 in 199ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:14,325 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 12f858663eed44690e97863779d6c54b: 2023-02-19 08:00:14,326 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fc5a61fc9e332779e04d53df613e1587: 2023-02-19 08:00:14,326 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:14,326 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:14,326 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 08:00:14,326 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 08:00:14,334 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/.tmp/f1/a3b4320e15ae4c7ca07165b18d66016c 2023-02-19 08:00:14,339 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/.tmp/f1/5ce664da08114312b7f9a4977214b303 2023-02-19 08:00:14,356 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/.tmp/f2/512876183bc64f52ac616070b2184016 2023-02-19 08:00:14,360 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/.tmp/f2/0f9375b10e2e4bba91c0cc8328bc26c3 2023-02-19 08:00:14,363 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/.tmp/f1/a3b4320e15ae4c7ca07165b18d66016c as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/a3b4320e15ae4c7ca07165b18d66016c 2023-02-19 08:00:14,366 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/.tmp/f1/5ce664da08114312b7f9a4977214b303 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/5ce664da08114312b7f9a4977214b303 2023-02-19 08:00:14,369 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/a3b4320e15ae4c7ca07165b18d66016c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:14,370 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/.tmp/f2/512876183bc64f52ac616070b2184016 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/512876183bc64f52ac616070b2184016 2023-02-19 08:00:14,373 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/5ce664da08114312b7f9a4977214b303, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,374 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/.tmp/f2/0f9375b10e2e4bba91c0cc8328bc26c3 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/0f9375b10e2e4bba91c0cc8328bc26c3 2023-02-19 08:00:14,377 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/512876183bc64f52ac616070b2184016, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:14,378 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 10266b2fcaa6ab45dac12ab3031b14e6 in 80ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:14,378 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 10266b2fcaa6ab45dac12ab3031b14e6: 2023-02-19 08:00:14,378 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:14,378 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 08:00:14,380 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/0f9375b10e2e4bba91c0cc8328bc26c3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,381 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9ece356a26d0f56e3e6639a5ac4967f0 in 86ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:14,381 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9ece356a26d0f56e3e6639a5ac4967f0: 2023-02-19 08:00:14,381 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:14,382 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 08:00:14,405 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-19 08:00:14,469 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-19 08:00:14,470 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-19 08:00:14,601 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/.tmp/f1/94b57a45b3504158bf66220c72ed5f4c 2023-02-19 08:00:14,617 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/.tmp/f2/926d05512dab4faba9fd87eebc26ceff 2023-02-19 08:00:14,623 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/.tmp/f1/94b57a45b3504158bf66220c72ed5f4c as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/94b57a45b3504158bf66220c72ed5f4c 2023-02-19 08:00:14,629 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/94b57a45b3504158bf66220c72ed5f4c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,630 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/.tmp/f2/926d05512dab4faba9fd87eebc26ceff as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/926d05512dab4faba9fd87eebc26ceff 2023-02-19 08:00:14,636 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/926d05512dab4faba9fd87eebc26ceff, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,637 INFO [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 377808f4fc665932de9d53239fd64839 in 522ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:14,637 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 377808f4fc665932de9d53239fd64839: 2023-02-19 08:00:14,637 DEBUG [rs(jenkins-hbase4.apache.org,43525,1676793605916)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 08:00:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 08:00:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 08:00:14,637 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43525,1676793605916' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 08:00:14,640 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,640 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:14,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:14,641 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,641 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:14,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:14,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:14,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:14,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43525,1676793605916' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 08:00:14,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38dc5b32[Count = 1] remaining members to acquire global barrier 2023-02-19 08:00:14,683 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/.tmp/f2/0f0d1b1cc1824ec88ca0038bdfdd5429 2023-02-19 08:00:14,690 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/.tmp/f1/920d8324838642b5af55ecda8a22b22e as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/920d8324838642b5af55ecda8a22b22e 2023-02-19 08:00:14,696 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/920d8324838642b5af55ecda8a22b22e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,697 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/.tmp/f2/0f0d1b1cc1824ec88ca0038bdfdd5429 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/0f0d1b1cc1824ec88ca0038bdfdd5429 2023-02-19 08:00:14,703 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/0f0d1b1cc1824ec88ca0038bdfdd5429, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:14,704 INFO [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for dcd361eae0971a2967db576c98a25ff9 in 580ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:14,704 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for dcd361eae0971a2967db576c98a25ff9: 2023-02-19 08:00:14,704 DEBUG [rs(jenkins-hbase4.apache.org,35991,1676793605965)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:14,704 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 08:00:14,704 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 08:00:14,704 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,704 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 08:00:14,704 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35991,1676793605965' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 08:00:14,707 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,707 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:14,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:14,708 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:14,708 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:14,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:14,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35991,1676793605965' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 08:00:14,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38dc5b32[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:14,710 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-19 08:00:14,710 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,712 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,712 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,713 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 08:00:14,713 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 08:00:14,713 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,713 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 08:00:14,713 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 08:00:14,713 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35991,1676793605965' in zk 2023-02-19 08:00:14,713 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43525,1676793605916' in zk 2023-02-19 08:00:14,713 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,713 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:14,715 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 08:00:14,715 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,715 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:14,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:14,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:14,716 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,715 DEBUG [member: 'jenkins-hbase4.apache.org,35991,1676793605965' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 08:00:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 08:00:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:14,716 DEBUG [member: 'jenkins-hbase4.apache.org,43525,1676793605916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 08:00:14,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:14,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:14,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:14,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:14,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:14,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35991,1676793605965': 2023-02-19 08:00:14,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35991,1676793605965' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-19 08:00:14,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:14,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:14,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:14,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:14,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:14,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:14,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:14,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43525,1676793605916': 2023-02-19 08:00:14,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43525,1676793605916' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-19 08:00:14,725 INFO [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-19 08:00:14,725 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:14,725 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:14,725 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-19 08:00:14,725 INFO [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 08:00:14,729 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,729 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:14,729 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:14,729 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,729 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:14,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:14,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:14,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:14,730 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:14,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:14,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,730 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:14,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:14,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:14,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,732 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,733 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:14,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,739 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,739 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:14,739 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:14,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:14,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:14,740 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:14,740 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:14,740 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:14,740 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:14,740 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:14,740 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,740 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:14,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:14,740 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:14,740 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:14,740 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:14,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-19 08:00:14,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 08:00:14,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:14,740 DEBUG [(jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:14,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:14,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-19 08:00:14,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:14,745 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:14,745 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 08:00:14,828 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 08:00:14,829 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-19 08:00:14,845 DEBUG [Listener at localhost/37093] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 08:00:14,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 08:00:14,949 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/hadoop-259612665242838336.jar 2023-02-19 08:00:14,965 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676793611636 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:14,966 DEBUG [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce 2023-02-19 08:00:14,967 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(239): region to add: 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:14,967 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(239): region to add: 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:14,967 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(239): region to add: a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:14,967 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(239): region to add: 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:14,967 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(239): region to add: 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(239): region to add: dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(239): region to add: 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(239): region to add: 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(239): region to add: fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(239): region to add: 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(585): clone region=377808f4fc665932de9d53239fd64839 as 377808f4fc665932de9d53239fd64839 in snapshot testWithMapReduceMultiRegion 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(585): clone region=6cd2c788ffa741e22b829f8fd3df39fa as 6cd2c788ffa741e22b829f8fd3df39fa in snapshot testWithMapReduceMultiRegion 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(585): clone region=a1c986905b4b75c76cb545a48eca56d5 as a1c986905b4b75c76cb545a48eca56d5 in snapshot testWithMapReduceMultiRegion 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(585): clone region=41e4f80f1dcd267361d2089538740658 as 41e4f80f1dcd267361d2089538740658 in snapshot testWithMapReduceMultiRegion 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(585): clone region=12f858663eed44690e97863779d6c54b as 12f858663eed44690e97863779d6c54b in snapshot testWithMapReduceMultiRegion 2023-02-19 08:00:14,968 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(585): clone region=dcd361eae0971a2967db576c98a25ff9 as dcd361eae0971a2967db576c98a25ff9 in snapshot testWithMapReduceMultiRegion 2023-02-19 08:00:14,969 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(585): clone region=9ece356a26d0f56e3e6639a5ac4967f0 as 9ece356a26d0f56e3e6639a5ac4967f0 in snapshot testWithMapReduceMultiRegion 2023-02-19 08:00:14,969 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(585): clone region=735a3357f6a3e4596852ead7c0349d64 as 735a3357f6a3e4596852ead7c0349d64 in snapshot testWithMapReduceMultiRegion 2023-02-19 08:00:14,969 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(585): clone region=fc5a61fc9e332779e04d53df613e1587 as fc5a61fc9e332779e04d53df613e1587 in snapshot testWithMapReduceMultiRegion 2023-02-19 08:00:14,969 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(585): clone region=10266b2fcaa6ab45dac12ab3031b14e6 as 10266b2fcaa6ab45dac12ab3031b14e6 in snapshot testWithMapReduceMultiRegion 2023-02-19 08:00:14,973 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 735a3357f6a3e4596852ead7c0349d64, NAME => 'testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:14,973 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => dcd361eae0971a2967db576c98a25ff9, NAME => 'testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:14,974 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 377808f4fc665932de9d53239fd64839, NAME => 'testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:14,974 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 12f858663eed44690e97863779d6c54b, NAME => 'testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:14,974 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 41e4f80f1dcd267361d2089538740658, NAME => 'testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:14,975 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => a1c986905b4b75c76cb545a48eca56d5, NAME => 'testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:14,975 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 9ece356a26d0f56e3e6639a5ac4967f0, NAME => 'testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:14,975 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6cd2c788ffa741e22b829f8fd3df39fa, NAME => 'testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:15,013 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,013 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cdf321db773f4b868e912dad1123b0be from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,023 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,023 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 44b34a072fe145bba304be71ba6b78f4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,025 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d0e31808382c4096b884a70642fde97b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,037 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,037 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 59d06bd46d2545bbafad43484714e879 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,049 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,049 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bc8f887456d4466bb869e459fcf87115 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,049 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,049 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 18e6b8d942624617831facd8c49b9f18 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,049 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 41e4f80f1dcd267361d2089538740658, disabling compactions & flushes 2023-02-19 08:00:15,050 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:15,050 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:15,050 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0f9a999f018f45b792da442beb18ad82 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,050 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. after waiting 0 ms 2023-02-19 08:00:15,050 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:15,050 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:15,050 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 41e4f80f1dcd267361d2089538740658: 2023-02-19 08:00:15,051 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => fc5a61fc9e332779e04d53df613e1587, NAME => 'testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:15,056 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,057 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 735a3357f6a3e4596852ead7c0349d64, disabling compactions & flushes 2023-02-19 08:00:15,057 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:15,057 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:15,057 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. after waiting 0 ms 2023-02-19 08:00:15,057 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:15,057 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:15,057 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 735a3357f6a3e4596852ead7c0349d64: 2023-02-19 08:00:15,058 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 10266b2fcaa6ab45dac12ab3031b14e6, NAME => 'testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:15,064 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,065 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 6cd2c788ffa741e22b829f8fd3df39fa, disabling compactions & flushes 2023-02-19 08:00:15,065 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:15,065 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:15,065 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. after waiting 0 ms 2023-02-19 08:00:15,065 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:15,065 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:15,065 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 6cd2c788ffa741e22b829f8fd3df39fa: 2023-02-19 08:00:15,065 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 207880324d71460a87aaea027bd14242 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,065 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 9ece356a26d0f56e3e6639a5ac4967f0, disabling compactions & flushes 2023-02-19 08:00:15,065 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:15,065 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:15,065 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. after waiting 0 ms 2023-02-19 08:00:15,066 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:15,066 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:15,066 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 9ece356a26d0f56e3e6639a5ac4967f0: 2023-02-19 08:00:15,068 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e561d1145e4449be99a229b16a7ed145 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,068 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,069 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 79331457b80f40eb8b250226197da8b3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,076 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 381e109adfd64ecba07d8a593628ed63 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 377808f4fc665932de9d53239fd64839, disabling compactions & flushes 2023-02-19 08:00:15,076 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:15,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:15,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. after waiting 0 ms 2023-02-19 08:00:15,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:15,076 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:15,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 377808f4fc665932de9d53239fd64839: 2023-02-19 08:00:15,080 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2a4d0831424f46f4a0619f0a7f11b73b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,083 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing dcd361eae0971a2967db576c98a25ff9, disabling compactions & flushes 2023-02-19 08:00:15,083 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing a1c986905b4b75c76cb545a48eca56d5, disabling compactions & flushes 2023-02-19 08:00:15,083 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:15,083 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:15,084 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. after waiting 0 ms 2023-02-19 08:00:15,084 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:15,084 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:15,084 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for dcd361eae0971a2967db576c98a25ff9: 2023-02-19 08:00:15,083 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:15,084 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:15,084 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. after waiting 0 ms 2023-02-19 08:00:15,084 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:15,084 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:15,084 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for a1c986905b4b75c76cb545a48eca56d5: 2023-02-19 08:00:15,086 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 12f858663eed44690e97863779d6c54b, disabling compactions & flushes 2023-02-19 08:00:15,086 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:15,086 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:15,086 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. after waiting 0 ms 2023-02-19 08:00:15,086 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:15,086 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:15,086 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 12f858663eed44690e97863779d6c54b: 2023-02-19 08:00:15,086 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,086 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 133ee053b18c40588fc7bcb0b6b3ff7f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,089 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6685626747c24ba0935e286bc59453c4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,090 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,090 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 61dd81b3cd4c4ce882df917e5dde87e1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,092 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 10266b2fcaa6ab45dac12ab3031b14e6, disabling compactions & flushes 2023-02-19 08:00:15,092 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:15,092 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:15,092 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. after waiting 0 ms 2023-02-19 08:00:15,092 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:15,093 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:15,093 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 10266b2fcaa6ab45dac12ab3031b14e6: 2023-02-19 08:00:15,093 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 576213703fda4924bca2a7824214ea00 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-19 08:00:15,095 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing fc5a61fc9e332779e04d53df613e1587, disabling compactions & flushes 2023-02-19 08:00:15,095 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:15,095 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:15,095 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. after waiting 0 ms 2023-02-19 08:00:15,095 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:15,095 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:15,095 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for fc5a61fc9e332779e04d53df613e1587: 2023-02-19 08:00:15,095 INFO [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676793611636 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:15,096 DEBUG [Listener at localhost/37093] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:15,096 DEBUG [Listener at localhost/37093] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89 2023-02-19 08:00:15,097 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-data/ 2023-02-19 08:00:15,097 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----default/ 2023-02-19 08:00:15,098 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-19 08:00:15,098 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----------10266b2fcaa6ab45dac12ab3031b14e6/ 2023-02-19 08:00:15,099 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:15,099 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:15,099 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=10266b2fcaa6ab45dac12ab3031b14e6-133ee053b18c40588fc7bcb0b6b3ff7f 2023-02-19 08:00:15,099 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:15,100 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=10266b2fcaa6ab45dac12ab3031b14e6-6685626747c24ba0935e286bc59453c4 2023-02-19 08:00:15,100 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----------12f858663eed44690e97863779d6c54b/ 2023-02-19 08:00:15,101 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:15,101 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:15,101 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=12f858663eed44690e97863779d6c54b-79331457b80f40eb8b250226197da8b3 2023-02-19 08:00:15,101 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:15,102 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=12f858663eed44690e97863779d6c54b-2a4d0831424f46f4a0619f0a7f11b73b 2023-02-19 08:00:15,102 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----------377808f4fc665932de9d53239fd64839/ 2023-02-19 08:00:15,102 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:15,102 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:15,103 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=377808f4fc665932de9d53239fd64839-bc8f887456d4466bb869e459fcf87115 2023-02-19 08:00:15,103 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:15,103 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=377808f4fc665932de9d53239fd64839-207880324d71460a87aaea027bd14242 2023-02-19 08:00:15,104 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----------41e4f80f1dcd267361d2089538740658/ 2023-02-19 08:00:15,104 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:15,104 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:15,105 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=41e4f80f1dcd267361d2089538740658-cdf321db773f4b868e912dad1123b0be 2023-02-19 08:00:15,105 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:15,105 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=41e4f80f1dcd267361d2089538740658-d0e31808382c4096b884a70642fde97b 2023-02-19 08:00:15,105 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----------6cd2c788ffa741e22b829f8fd3df39fa/ 2023-02-19 08:00:15,106 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:15,106 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----------735a3357f6a3e4596852ead7c0349d64/ 2023-02-19 08:00:15,106 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:15,106 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----------9ece356a26d0f56e3e6639a5ac4967f0/ 2023-02-19 08:00:15,107 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:15,107 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:15,108 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=9ece356a26d0f56e3e6639a5ac4967f0-44b34a072fe145bba304be71ba6b78f4 2023-02-19 08:00:15,108 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:15,108 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=9ece356a26d0f56e3e6639a5ac4967f0-0f9a999f018f45b792da442beb18ad82 2023-02-19 08:00:15,108 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----------a1c986905b4b75c76cb545a48eca56d5/ 2023-02-19 08:00:15,109 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:15,109 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:15,109 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=a1c986905b4b75c76cb545a48eca56d5-18e6b8d942624617831facd8c49b9f18 2023-02-19 08:00:15,109 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:15,110 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=a1c986905b4b75c76cb545a48eca56d5-381e109adfd64ecba07d8a593628ed63 2023-02-19 08:00:15,110 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----------dcd361eae0971a2967db576c98a25ff9/ 2023-02-19 08:00:15,110 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:15,110 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:15,111 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=dcd361eae0971a2967db576c98a25ff9-59d06bd46d2545bbafad43484714e879 2023-02-19 08:00:15,111 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:15,111 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=dcd361eae0971a2967db576c98a25ff9-e561d1145e4449be99a229b16a7ed145 2023-02-19 08:00:15,112 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |----------fc5a61fc9e332779e04d53df613e1587/ 2023-02-19 08:00:15,112 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:15,112 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:15,113 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=fc5a61fc9e332779e04d53df613e1587-61dd81b3cd4c4ce882df917e5dde87e1 2023-02-19 08:00:15,113 DEBUG [Listener at localhost/37093] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:15,113 DEBUG [Listener at localhost/37093] util.CommonFSUtils(702): |----------------testWithMapReduce=fc5a61fc9e332779e04d53df613e1587-576213703fda4924bca2a7824214ea00 2023-02-19 08:00:15,121 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,122 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,123 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,123 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,124 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,124 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,125 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,198 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/hadoop-4005048668246873936.jar 2023-02-19 08:00:15,199 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,199 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,200 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,200 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,201 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,201 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,202 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-19 08:00:15,202 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-19 08:00:15,203 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-19 08:00:15,203 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-19 08:00:15,204 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-19 08:00:15,204 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-19 08:00:15,205 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-19 08:00:15,205 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-19 08:00:15,206 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-19 08:00:15,207 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-19 08:00:15,212 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:15,213 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 08:00:15,213 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 08:00:15,214 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 08:00:15,214 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 08:00:15,283 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/hadoop-2938243546027809334.jar 2023-02-19 08:00:15,283 DEBUG [Listener at localhost/37093] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 08:00:15,335 WARN [Listener at localhost/37093] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-19 08:00:15,400 INFO [Listener at localhost/37093] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 08:00:15,748 WARN [Listener at localhost/37093] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/mapreduce.cluster.local.dir/1676793615672/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-19 08:00:15,748 WARN [Listener at localhost/37093] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/mapreduce.cluster.local.dir/1676793615672/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-19 08:00:15,926 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:15,926 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:15,928 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:15,930 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:15,931 DEBUG [StoreOpener-12f858663eed44690e97863779d6c54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1 2023-02-19 08:00:15,931 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12f858663eed44690e97863779d6c54b columnFamilyName f1 2023-02-19 08:00:15,942 DEBUG [StoreOpener-12f858663eed44690e97863779d6c54b-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/testWithMapReduce=12f858663eed44690e97863779d6c54b-79331457b80f40eb8b250226197da8b3 2023-02-19 08:00:15,943 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] regionserver.HStore(310): Store=12f858663eed44690e97863779d6c54b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:15,943 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:15,944 DEBUG [StoreOpener-12f858663eed44690e97863779d6c54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2 2023-02-19 08:00:15,944 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12f858663eed44690e97863779d6c54b columnFamilyName f2 2023-02-19 08:00:15,949 DEBUG [StoreOpener-12f858663eed44690e97863779d6c54b-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/testWithMapReduce=12f858663eed44690e97863779d6c54b-2a4d0831424f46f4a0619f0a7f11b73b 2023-02-19 08:00:15,950 INFO [StoreOpener-12f858663eed44690e97863779d6c54b-1] regionserver.HStore(310): Store=12f858663eed44690e97863779d6c54b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:15,950 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:15,950 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 12f858663eed44690e97863779d6c54b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70717786, jitterRate=0.05377712845802307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:15,950 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 12f858663eed44690e97863779d6c54b: 2023-02-19 08:00:16,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 12f858663eed44690e97863779d6c54b, disabling compactions & flushes 2023-02-19 08:00:16,109 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:16,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:16,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. after waiting 0 ms 2023-02-19 08:00:16,109 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:16,116 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:16,117 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 12f858663eed44690e97863779d6c54b: 2023-02-19 08:00:16,138 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:16,138 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:16,140 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:16,142 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:16,144 DEBUG [StoreOpener-377808f4fc665932de9d53239fd64839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1 2023-02-19 08:00:16,144 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 377808f4fc665932de9d53239fd64839 columnFamilyName f1 2023-02-19 08:00:16,153 DEBUG [StoreOpener-377808f4fc665932de9d53239fd64839-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/testWithMapReduce=377808f4fc665932de9d53239fd64839-bc8f887456d4466bb869e459fcf87115 2023-02-19 08:00:16,153 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] regionserver.HStore(310): Store=377808f4fc665932de9d53239fd64839/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,153 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:16,154 DEBUG [StoreOpener-377808f4fc665932de9d53239fd64839-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2 2023-02-19 08:00:16,155 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 377808f4fc665932de9d53239fd64839 columnFamilyName f2 2023-02-19 08:00:16,160 DEBUG [StoreOpener-377808f4fc665932de9d53239fd64839-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/testWithMapReduce=377808f4fc665932de9d53239fd64839-207880324d71460a87aaea027bd14242 2023-02-19 08:00:16,161 INFO [StoreOpener-377808f4fc665932de9d53239fd64839-1] regionserver.HStore(310): Store=377808f4fc665932de9d53239fd64839/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:16,162 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 377808f4fc665932de9d53239fd64839; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67142643, jitterRate=5.0334632396698E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:16,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 377808f4fc665932de9d53239fd64839: 2023-02-19 08:00:16,200 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 377808f4fc665932de9d53239fd64839, disabling compactions & flushes 2023-02-19 08:00:16,201 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:16,201 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:16,201 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. after waiting 0 ms 2023-02-19 08:00:16,201 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:16,204 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:16,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 377808f4fc665932de9d53239fd64839: 2023-02-19 08:00:16,208 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:16,208 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:16,209 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:16,214 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:16,216 DEBUG [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1 2023-02-19 08:00:16,216 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10266b2fcaa6ab45dac12ab3031b14e6 columnFamilyName f1 2023-02-19 08:00:16,226 DEBUG [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/testWithMapReduce=10266b2fcaa6ab45dac12ab3031b14e6-133ee053b18c40588fc7bcb0b6b3ff7f 2023-02-19 08:00:16,226 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] regionserver.HStore(310): Store=10266b2fcaa6ab45dac12ab3031b14e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,227 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:16,228 DEBUG [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2 2023-02-19 08:00:16,228 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10266b2fcaa6ab45dac12ab3031b14e6 columnFamilyName f2 2023-02-19 08:00:16,234 DEBUG [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/testWithMapReduce=10266b2fcaa6ab45dac12ab3031b14e6-6685626747c24ba0935e286bc59453c4 2023-02-19 08:00:16,235 INFO [StoreOpener-10266b2fcaa6ab45dac12ab3031b14e6-1] regionserver.HStore(310): Store=10266b2fcaa6ab45dac12ab3031b14e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,235 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:16,235 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 10266b2fcaa6ab45dac12ab3031b14e6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71392664, jitterRate=0.06383359432220459}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:16,235 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 10266b2fcaa6ab45dac12ab3031b14e6: 2023-02-19 08:00:16,293 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 10266b2fcaa6ab45dac12ab3031b14e6, disabling compactions & flushes 2023-02-19 08:00:16,293 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:16,294 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:16,294 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. after waiting 0 ms 2023-02-19 08:00:16,294 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:16,297 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:16,297 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 10266b2fcaa6ab45dac12ab3031b14e6: 2023-02-19 08:00:16,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:16,303 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:16,305 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:16,307 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:16,308 DEBUG [StoreOpener-41e4f80f1dcd267361d2089538740658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1 2023-02-19 08:00:16,308 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41e4f80f1dcd267361d2089538740658 columnFamilyName f1 2023-02-19 08:00:16,318 DEBUG [StoreOpener-41e4f80f1dcd267361d2089538740658-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/testWithMapReduce=41e4f80f1dcd267361d2089538740658-cdf321db773f4b868e912dad1123b0be 2023-02-19 08:00:16,318 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] regionserver.HStore(310): Store=41e4f80f1dcd267361d2089538740658/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,318 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:16,319 DEBUG [StoreOpener-41e4f80f1dcd267361d2089538740658-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2 2023-02-19 08:00:16,320 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41e4f80f1dcd267361d2089538740658 columnFamilyName f2 2023-02-19 08:00:16,326 DEBUG [StoreOpener-41e4f80f1dcd267361d2089538740658-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/testWithMapReduce=41e4f80f1dcd267361d2089538740658-d0e31808382c4096b884a70642fde97b 2023-02-19 08:00:16,327 INFO [StoreOpener-41e4f80f1dcd267361d2089538740658-1] regionserver.HStore(310): Store=41e4f80f1dcd267361d2089538740658/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:16,327 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 41e4f80f1dcd267361d2089538740658; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65819947, jitterRate=-0.01920635998249054}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:16,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 41e4f80f1dcd267361d2089538740658: 2023-02-19 08:00:16,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 41e4f80f1dcd267361d2089538740658, disabling compactions & flushes 2023-02-19 08:00:16,387 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:16,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:16,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. after waiting 0 ms 2023-02-19 08:00:16,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:16,397 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:16,397 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 41e4f80f1dcd267361d2089538740658: 2023-02-19 08:00:16,403 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:16,404 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:16,408 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:16,410 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:16,412 DEBUG [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1 2023-02-19 08:00:16,412 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ece356a26d0f56e3e6639a5ac4967f0 columnFamilyName f1 2023-02-19 08:00:16,422 DEBUG [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/testWithMapReduce=9ece356a26d0f56e3e6639a5ac4967f0-44b34a072fe145bba304be71ba6b78f4 2023-02-19 08:00:16,422 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] regionserver.HStore(310): Store=9ece356a26d0f56e3e6639a5ac4967f0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,422 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:16,423 DEBUG [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2 2023-02-19 08:00:16,424 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ece356a26d0f56e3e6639a5ac4967f0 columnFamilyName f2 2023-02-19 08:00:16,434 DEBUG [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/testWithMapReduce=9ece356a26d0f56e3e6639a5ac4967f0-0f9a999f018f45b792da442beb18ad82 2023-02-19 08:00:16,434 INFO [StoreOpener-9ece356a26d0f56e3e6639a5ac4967f0-1] regionserver.HStore(310): Store=9ece356a26d0f56e3e6639a5ac4967f0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,435 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:16,435 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9ece356a26d0f56e3e6639a5ac4967f0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62498518, jitterRate=-0.06869950890541077}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:16,435 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9ece356a26d0f56e3e6639a5ac4967f0: 2023-02-19 08:00:16,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9ece356a26d0f56e3e6639a5ac4967f0, disabling compactions & flushes 2023-02-19 08:00:16,509 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:16,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:16,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. after waiting 0 ms 2023-02-19 08:00:16,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:16,514 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:16,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9ece356a26d0f56e3e6639a5ac4967f0: 2023-02-19 08:00:16,521 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:16,522 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:16,524 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:16,526 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:16,528 DEBUG [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/f1 2023-02-19 08:00:16,528 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 735a3357f6a3e4596852ead7c0349d64 columnFamilyName f1 2023-02-19 08:00:16,529 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] regionserver.HStore(310): Store=735a3357f6a3e4596852ead7c0349d64/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,529 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:16,530 DEBUG [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/f2 2023-02-19 08:00:16,530 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 735a3357f6a3e4596852ead7c0349d64 columnFamilyName f2 2023-02-19 08:00:16,531 INFO [StoreOpener-735a3357f6a3e4596852ead7c0349d64-1] regionserver.HStore(310): Store=735a3357f6a3e4596852ead7c0349d64/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,531 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:16,531 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 735a3357f6a3e4596852ead7c0349d64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66336316, jitterRate=-0.01151186227798462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:16,531 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 735a3357f6a3e4596852ead7c0349d64: 2023-02-19 08:00:16,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 735a3357f6a3e4596852ead7c0349d64, disabling compactions & flushes 2023-02-19 08:00:16,550 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:16,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:16,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. after waiting 0 ms 2023-02-19 08:00:16,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:16,550 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:16,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 735a3357f6a3e4596852ead7c0349d64: 2023-02-19 08:00:16,555 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:16,555 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:16,556 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:16,558 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:16,559 DEBUG [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1 2023-02-19 08:00:16,560 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc5a61fc9e332779e04d53df613e1587 columnFamilyName f1 2023-02-19 08:00:16,567 DEBUG [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/testWithMapReduce=fc5a61fc9e332779e04d53df613e1587-61dd81b3cd4c4ce882df917e5dde87e1 2023-02-19 08:00:16,568 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] regionserver.HStore(310): Store=fc5a61fc9e332779e04d53df613e1587/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,568 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:16,569 DEBUG [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2 2023-02-19 08:00:16,569 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc5a61fc9e332779e04d53df613e1587 columnFamilyName f2 2023-02-19 08:00:16,576 DEBUG [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/testWithMapReduce=fc5a61fc9e332779e04d53df613e1587-576213703fda4924bca2a7824214ea00 2023-02-19 08:00:16,576 INFO [StoreOpener-fc5a61fc9e332779e04d53df613e1587-1] regionserver.HStore(310): Store=fc5a61fc9e332779e04d53df613e1587/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,576 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:16,576 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fc5a61fc9e332779e04d53df613e1587; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65637335, jitterRate=-0.021927490830421448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:16,576 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fc5a61fc9e332779e04d53df613e1587: 2023-02-19 08:00:16,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fc5a61fc9e332779e04d53df613e1587, disabling compactions & flushes 2023-02-19 08:00:16,619 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:16,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:16,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. after waiting 0 ms 2023-02-19 08:00:16,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:16,622 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:16,622 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fc5a61fc9e332779e04d53df613e1587: 2023-02-19 08:00:16,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:16,629 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:16,631 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:16,633 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:16,635 DEBUG [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1 2023-02-19 08:00:16,635 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dcd361eae0971a2967db576c98a25ff9 columnFamilyName f1 2023-02-19 08:00:16,642 DEBUG [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/testWithMapReduce=dcd361eae0971a2967db576c98a25ff9-59d06bd46d2545bbafad43484714e879 2023-02-19 08:00:16,642 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] regionserver.HStore(310): Store=dcd361eae0971a2967db576c98a25ff9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,642 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:16,645 DEBUG [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2 2023-02-19 08:00:16,645 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dcd361eae0971a2967db576c98a25ff9 columnFamilyName f2 2023-02-19 08:00:16,655 DEBUG [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/testWithMapReduce=dcd361eae0971a2967db576c98a25ff9-e561d1145e4449be99a229b16a7ed145 2023-02-19 08:00:16,655 INFO [StoreOpener-dcd361eae0971a2967db576c98a25ff9-1] regionserver.HStore(310): Store=dcd361eae0971a2967db576c98a25ff9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,655 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:16,656 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dcd361eae0971a2967db576c98a25ff9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70552495, jitterRate=0.0513141006231308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:16,656 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dcd361eae0971a2967db576c98a25ff9: 2023-02-19 08:00:16,686 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dcd361eae0971a2967db576c98a25ff9, disabling compactions & flushes 2023-02-19 08:00:16,686 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:16,686 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:16,686 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. after waiting 0 ms 2023-02-19 08:00:16,686 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:16,697 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:16,697 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dcd361eae0971a2967db576c98a25ff9: 2023-02-19 08:00:16,705 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:16,706 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:16,711 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:16,715 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:16,717 DEBUG [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/f1 2023-02-19 08:00:16,717 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cd2c788ffa741e22b829f8fd3df39fa columnFamilyName f1 2023-02-19 08:00:16,718 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] regionserver.HStore(310): Store=6cd2c788ffa741e22b829f8fd3df39fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,718 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:16,719 DEBUG [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/f2 2023-02-19 08:00:16,720 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cd2c788ffa741e22b829f8fd3df39fa columnFamilyName f2 2023-02-19 08:00:16,721 INFO [StoreOpener-6cd2c788ffa741e22b829f8fd3df39fa-1] regionserver.HStore(310): Store=6cd2c788ffa741e22b829f8fd3df39fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,721 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:16,722 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6cd2c788ffa741e22b829f8fd3df39fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74988649, jitterRate=0.11741794645786285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:16,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6cd2c788ffa741e22b829f8fd3df39fa: 2023-02-19 08:00:16,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6cd2c788ffa741e22b829f8fd3df39fa, disabling compactions & flushes 2023-02-19 08:00:16,744 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:16,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:16,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. after waiting 0 ms 2023-02-19 08:00:16,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:16,745 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:16,745 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6cd2c788ffa741e22b829f8fd3df39fa: 2023-02-19 08:00:16,749 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:16,749 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:16,752 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:16,754 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:16,755 DEBUG [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1 2023-02-19 08:00:16,755 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1c986905b4b75c76cb545a48eca56d5 columnFamilyName f1 2023-02-19 08:00:16,761 DEBUG [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/testWithMapReduce=a1c986905b4b75c76cb545a48eca56d5-18e6b8d942624617831facd8c49b9f18 2023-02-19 08:00:16,761 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] regionserver.HStore(310): Store=a1c986905b4b75c76cb545a48eca56d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,761 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:16,762 DEBUG [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2 2023-02-19 08:00:16,762 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1c986905b4b75c76cb545a48eca56d5 columnFamilyName f2 2023-02-19 08:00:16,768 DEBUG [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] regionserver.HStore(539): loaded hdfs://localhost:33697/user/jenkins/test-data/909c010e-9b5f-2f33-3194-92a3b6de69c3/testWithMapReduceMultiRegion/4a61e433-5510-4486-af17-c72798507f89/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/testWithMapReduce=a1c986905b4b75c76cb545a48eca56d5-381e109adfd64ecba07d8a593628ed63 2023-02-19 08:00:16,768 INFO [StoreOpener-a1c986905b4b75c76cb545a48eca56d5-1] regionserver.HStore(310): Store=a1c986905b4b75c76cb545a48eca56d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:16,768 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:16,768 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a1c986905b4b75c76cb545a48eca56d5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65108313, jitterRate=-0.029810532927513123}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:16,768 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a1c986905b4b75c76cb545a48eca56d5: 2023-02-19 08:00:16,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a1c986905b4b75c76cb545a48eca56d5, disabling compactions & flushes 2023-02-19 08:00:16,817 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:16,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:16,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. after waiting 0 ms 2023-02-19 08:00:16,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:16,822 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:16,822 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a1c986905b4b75c76cb545a48eca56d5: 2023-02-19 08:00:17,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-19 08:00:17,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-19 08:00:17,882 INFO [Listener at localhost/37093] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 08:00:17,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 08:00:17,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-19 08:00:17,894 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793617894"}]},"ts":"1676793617894"} 2023-02-19 08:00:17,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 08:00:17,897 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-19 08:00:17,899 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-19 08:00:17,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=735a3357f6a3e4596852ead7c0349d64, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=10266b2fcaa6ab45dac12ab3031b14e6, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=12f858663eed44690e97863779d6c54b, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=41e4f80f1dcd267361d2089538740658, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a1c986905b4b75c76cb545a48eca56d5, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=377808f4fc665932de9d53239fd64839, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dcd361eae0971a2967db576c98a25ff9, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9ece356a26d0f56e3e6639a5ac4967f0, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fc5a61fc9e332779e04d53df613e1587, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6cd2c788ffa741e22b829f8fd3df39fa, UNASSIGN}] 2023-02-19 08:00:17,906 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fc5a61fc9e332779e04d53df613e1587, UNASSIGN 2023-02-19 08:00:17,906 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dcd361eae0971a2967db576c98a25ff9, UNASSIGN 2023-02-19 08:00:17,906 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=377808f4fc665932de9d53239fd64839, UNASSIGN 2023-02-19 08:00:17,906 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9ece356a26d0f56e3e6639a5ac4967f0, UNASSIGN 2023-02-19 08:00:17,906 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6cd2c788ffa741e22b829f8fd3df39fa, UNASSIGN 2023-02-19 08:00:17,907 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=fc5a61fc9e332779e04d53df613e1587, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:17,907 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793617907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793617907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793617907"}]},"ts":"1676793617907"} 2023-02-19 08:00:17,908 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=dcd361eae0971a2967db576c98a25ff9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:17,908 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=377808f4fc665932de9d53239fd64839, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:17,908 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793617908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793617908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793617908"}]},"ts":"1676793617908"} 2023-02-19 08:00:17,908 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676793609932.377808f4fc665932de9d53239fd64839.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793617908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793617908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793617908"}]},"ts":"1676793617908"} 2023-02-19 08:00:17,909 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6cd2c788ffa741e22b829f8fd3df39fa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:17,909 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=9ece356a26d0f56e3e6639a5ac4967f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:17,909 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793617908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793617908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793617908"}]},"ts":"1676793617908"} 2023-02-19 08:00:17,909 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793617908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793617908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793617908"}]},"ts":"1676793617908"} 2023-02-19 08:00:17,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=42, state=RUNNABLE; CloseRegionProcedure fc5a61fc9e332779e04d53df613e1587, server=jenkins-hbase4.apache.org,35991,1676793605965}] 2023-02-19 08:00:17,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=40, state=RUNNABLE; CloseRegionProcedure dcd361eae0971a2967db576c98a25ff9, server=jenkins-hbase4.apache.org,35991,1676793605965}] 2023-02-19 08:00:17,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure 377808f4fc665932de9d53239fd64839, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:17,915 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 6cd2c788ffa741e22b829f8fd3df39fa, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:17,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=41, state=RUNNABLE; CloseRegionProcedure 9ece356a26d0f56e3e6639a5ac4967f0, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:17,920 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a1c986905b4b75c76cb545a48eca56d5, UNASSIGN 2023-02-19 08:00:17,920 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=41e4f80f1dcd267361d2089538740658, UNASSIGN 2023-02-19 08:00:17,920 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=12f858663eed44690e97863779d6c54b, UNASSIGN 2023-02-19 08:00:17,920 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=10266b2fcaa6ab45dac12ab3031b14e6, UNASSIGN 2023-02-19 08:00:17,922 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=735a3357f6a3e4596852ead7c0349d64, UNASSIGN 2023-02-19 08:00:17,922 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=10266b2fcaa6ab45dac12ab3031b14e6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:17,922 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=12f858663eed44690e97863779d6c54b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:17,922 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=41e4f80f1dcd267361d2089538740658, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:17,922 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a1c986905b4b75c76cb545a48eca56d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:17,922 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676793609932.12f858663eed44690e97863779d6c54b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793617922"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793617922"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793617922"}]},"ts":"1676793617922"} 2023-02-19 08:00:17,922 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793617922"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793617922"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793617922"}]},"ts":"1676793617922"} 2023-02-19 08:00:17,922 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793617922"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793617922"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793617922"}]},"ts":"1676793617922"} 2023-02-19 08:00:17,922 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793617922"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793617922"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793617922"}]},"ts":"1676793617922"} 2023-02-19 08:00:17,923 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=735a3357f6a3e4596852ead7c0349d64, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:17,923 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793617923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793617923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793617923"}]},"ts":"1676793617923"} 2023-02-19 08:00:17,925 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=36, state=RUNNABLE; CloseRegionProcedure 12f858663eed44690e97863779d6c54b, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:17,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=38, state=RUNNABLE; CloseRegionProcedure a1c986905b4b75c76cb545a48eca56d5, server=jenkins-hbase4.apache.org,35991,1676793605965}] 2023-02-19 08:00:17,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=37, state=RUNNABLE; CloseRegionProcedure 41e4f80f1dcd267361d2089538740658, server=jenkins-hbase4.apache.org,43525,1676793605916}] 2023-02-19 08:00:17,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 10266b2fcaa6ab45dac12ab3031b14e6, server=jenkins-hbase4.apache.org,35991,1676793605965}] 2023-02-19 08:00:17,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 735a3357f6a3e4596852ead7c0349d64, server=jenkins-hbase4.apache.org,35991,1676793605965}] 2023-02-19 08:00:17,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 08:00:18,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:18,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dcd361eae0971a2967db576c98a25ff9, disabling compactions & flushes 2023-02-19 08:00:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 41e4f80f1dcd267361d2089538740658, disabling compactions & flushes 2023-02-19 08:00:18,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:18,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. after waiting 0 ms 2023-02-19 08:00:18,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. after waiting 0 ms 2023-02-19 08:00:18,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:18,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:18,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:18,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:18,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9. 2023-02-19 08:00:18,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dcd361eae0971a2967db576c98a25ff9: 2023-02-19 08:00:18,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658. 2023-02-19 08:00:18,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 41e4f80f1dcd267361d2089538740658: 2023-02-19 08:00:18,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:18,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:18,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a1c986905b4b75c76cb545a48eca56d5, disabling compactions & flushes 2023-02-19 08:00:18,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:18,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:18,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. after waiting 0 ms 2023-02-19 08:00:18,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:18,092 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=dcd361eae0971a2967db576c98a25ff9, regionState=CLOSED 2023-02-19 08:00:18,092 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793618092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793618092"}]},"ts":"1676793618092"} 2023-02-19 08:00:18,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:18,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 377808f4fc665932de9d53239fd64839, disabling compactions & flushes 2023-02-19 08:00:18,093 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=41e4f80f1dcd267361d2089538740658, regionState=CLOSED 2023-02-19 08:00:18,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. after waiting 0 ms 2023-02-19 08:00:18,093 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793618093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793618093"}]},"ts":"1676793618093"} 2023-02-19 08:00:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:18,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=40 2023-02-19 08:00:18,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=40, state=SUCCESS; CloseRegionProcedure dcd361eae0971a2967db576c98a25ff9, server=jenkins-hbase4.apache.org,35991,1676793605965 in 185 msec 2023-02-19 08:00:18,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=37 2023-02-19 08:00:18,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=37, state=SUCCESS; CloseRegionProcedure 41e4f80f1dcd267361d2089538740658, server=jenkins-hbase4.apache.org,43525,1676793605916 in 170 msec 2023-02-19 08:00:18,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dcd361eae0971a2967db576c98a25ff9, UNASSIGN in 200 msec 2023-02-19 08:00:18,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=41e4f80f1dcd267361d2089538740658, UNASSIGN in 202 msec 2023-02-19 08:00:18,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:18,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:18,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5. 2023-02-19 08:00:18,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a1c986905b4b75c76cb545a48eca56d5: 2023-02-19 08:00:18,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839. 2023-02-19 08:00:18,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 377808f4fc665932de9d53239fd64839: 2023-02-19 08:00:18,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:18,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:18,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 735a3357f6a3e4596852ead7c0349d64, disabling compactions & flushes 2023-02-19 08:00:18,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:18,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:18,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. after waiting 0 ms 2023-02-19 08:00:18,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:18,126 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a1c986905b4b75c76cb545a48eca56d5, regionState=CLOSED 2023-02-19 08:00:18,126 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793618126"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793618126"}]},"ts":"1676793618126"} 2023-02-19 08:00:18,128 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=377808f4fc665932de9d53239fd64839, regionState=CLOSED 2023-02-19 08:00:18,128 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676793609932.377808f4fc665932de9d53239fd64839.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793618128"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793618128"}]},"ts":"1676793618128"} 2023-02-19 08:00:18,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 08:00:18,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64. 2023-02-19 08:00:18,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 735a3357f6a3e4596852ead7c0349d64: 2023-02-19 08:00:18,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 377808f4fc665932de9d53239fd64839 2023-02-19 08:00:18,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:18,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6cd2c788ffa741e22b829f8fd3df39fa, disabling compactions & flushes 2023-02-19 08:00:18,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:18,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:18,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. after waiting 0 ms 2023-02-19 08:00:18,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:18,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:18,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:18,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fc5a61fc9e332779e04d53df613e1587, disabling compactions & flushes 2023-02-19 08:00:18,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:18,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:18,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=38 2023-02-19 08:00:18,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=38, state=SUCCESS; CloseRegionProcedure a1c986905b4b75c76cb545a48eca56d5, server=jenkins-hbase4.apache.org,35991,1676793605965 in 204 msec 2023-02-19 08:00:18,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. after waiting 0 ms 2023-02-19 08:00:18,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:18,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-19 08:00:18,137 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=735a3357f6a3e4596852ead7c0349d64, regionState=CLOSED 2023-02-19 08:00:18,137 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793618137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793618137"}]},"ts":"1676793618137"} 2023-02-19 08:00:18,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure 377808f4fc665932de9d53239fd64839, server=jenkins-hbase4.apache.org,43525,1676793605916 in 219 msec 2023-02-19 08:00:18,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a1c986905b4b75c76cb545a48eca56d5, UNASSIGN in 235 msec 2023-02-19 08:00:18,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=377808f4fc665932de9d53239fd64839, UNASSIGN in 236 msec 2023-02-19 08:00:18,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-19 08:00:18,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 735a3357f6a3e4596852ead7c0349d64, server=jenkins-hbase4.apache.org,35991,1676793605965 in 210 msec 2023-02-19 08:00:18,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=735a3357f6a3e4596852ead7c0349d64, UNASSIGN in 249 msec 2023-02-19 08:00:18,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 08:00:18,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa. 2023-02-19 08:00:18,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6cd2c788ffa741e22b829f8fd3df39fa: 2023-02-19 08:00:18,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:18,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587. 2023-02-19 08:00:18,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fc5a61fc9e332779e04d53df613e1587: 2023-02-19 08:00:18,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:18,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:18,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9ece356a26d0f56e3e6639a5ac4967f0, disabling compactions & flushes 2023-02-19 08:00:18,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:18,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:18,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. after waiting 0 ms 2023-02-19 08:00:18,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:18,159 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6cd2c788ffa741e22b829f8fd3df39fa, regionState=CLOSED 2023-02-19 08:00:18,160 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793618159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793618159"}]},"ts":"1676793618159"} 2023-02-19 08:00:18,161 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=fc5a61fc9e332779e04d53df613e1587, regionState=CLOSED 2023-02-19 08:00:18,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793618161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793618161"}]},"ts":"1676793618161"} 2023-02-19 08:00:18,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:18,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:18,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 10266b2fcaa6ab45dac12ab3031b14e6, disabling compactions & flushes 2023-02-19 08:00:18,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:18,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:18,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. after waiting 0 ms 2023-02-19 08:00:18,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:18,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-19 08:00:18,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 6cd2c788ffa741e22b829f8fd3df39fa, server=jenkins-hbase4.apache.org,43525,1676793605916 in 247 msec 2023-02-19 08:00:18,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-02-19 08:00:18,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; CloseRegionProcedure fc5a61fc9e332779e04d53df613e1587, server=jenkins-hbase4.apache.org,35991,1676793605965 in 255 msec 2023-02-19 08:00:18,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6cd2c788ffa741e22b829f8fd3df39fa, UNASSIGN in 264 msec 2023-02-19 08:00:18,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fc5a61fc9e332779e04d53df613e1587, UNASSIGN in 265 msec 2023-02-19 08:00:18,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:18,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0. 2023-02-19 08:00:18,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9ece356a26d0f56e3e6639a5ac4967f0: 2023-02-19 08:00:18,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:18,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 08:00:18,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:18,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:18,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 12f858663eed44690e97863779d6c54b, disabling compactions & flushes 2023-02-19 08:00:18,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:18,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6. 2023-02-19 08:00:18,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:18,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. after waiting 0 ms 2023-02-19 08:00:18,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 10266b2fcaa6ab45dac12ab3031b14e6: 2023-02-19 08:00:18,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:18,202 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=9ece356a26d0f56e3e6639a5ac4967f0, regionState=CLOSED 2023-02-19 08:00:18,202 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793618201"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793618201"}]},"ts":"1676793618201"} 2023-02-19 08:00:18,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:18,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b. 2023-02-19 08:00:18,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 12f858663eed44690e97863779d6c54b: 2023-02-19 08:00:18,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:18,212 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=10266b2fcaa6ab45dac12ab3031b14e6, regionState=CLOSED 2023-02-19 08:00:18,213 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793618212"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793618212"}]},"ts":"1676793618212"} 2023-02-19 08:00:18,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=41 2023-02-19 08:00:18,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 12f858663eed44690e97863779d6c54b 2023-02-19 08:00:18,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=41, state=SUCCESS; CloseRegionProcedure 9ece356a26d0f56e3e6639a5ac4967f0, server=jenkins-hbase4.apache.org,43525,1676793605916 in 287 msec 2023-02-19 08:00:18,215 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=12f858663eed44690e97863779d6c54b, regionState=CLOSED 2023-02-19 08:00:18,215 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676793609932.12f858663eed44690e97863779d6c54b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793618215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793618215"}]},"ts":"1676793618215"} 2023-02-19 08:00:18,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9ece356a26d0f56e3e6639a5ac4967f0, UNASSIGN in 313 msec 2023-02-19 08:00:18,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-19 08:00:18,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 10266b2fcaa6ab45dac12ab3031b14e6, server=jenkins-hbase4.apache.org,35991,1676793605965 in 286 msec 2023-02-19 08:00:18,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=36 2023-02-19 08:00:18,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=10266b2fcaa6ab45dac12ab3031b14e6, UNASSIGN in 317 msec 2023-02-19 08:00:18,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=36, state=SUCCESS; CloseRegionProcedure 12f858663eed44690e97863779d6c54b, server=jenkins-hbase4.apache.org,43525,1676793605916 in 292 msec 2023-02-19 08:00:18,221 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=33 2023-02-19 08:00:18,221 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=12f858663eed44690e97863779d6c54b, UNASSIGN in 318 msec 2023-02-19 08:00:18,222 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793618222"}]},"ts":"1676793618222"} 2023-02-19 08:00:18,224 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-19 08:00:18,228 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-19 08:00:18,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 345 msec 2023-02-19 08:00:18,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 08:00:18,503 INFO [Listener at localhost/37093] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-19 08:00:18,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-19 08:00:18,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:18,516 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:18,518 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:18,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 08:00:18,534 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:18,535 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b 2023-02-19 08:00:18,535 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:18,535 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839 2023-02-19 08:00:18,535 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:18,534 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:18,535 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:18,535 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:18,540 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/f1, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/f2, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/recovered.edits] 2023-02-19 08:00:18,541 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/recovered.edits] 2023-02-19 08:00:18,540 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/recovered.edits] 2023-02-19 08:00:18,541 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/recovered.edits] 2023-02-19 08:00:18,541 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/recovered.edits] 2023-02-19 08:00:18,542 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/recovered.edits] 2023-02-19 08:00:18,542 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/recovered.edits] 2023-02-19 08:00:18,545 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/recovered.edits] 2023-02-19 08:00:18,566 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/18e6b8d942624617831facd8c49b9f18 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/18e6b8d942624617831facd8c49b9f18 2023-02-19 08:00:18,566 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/94b57a45b3504158bf66220c72ed5f4c to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/94b57a45b3504158bf66220c72ed5f4c 2023-02-19 08:00:18,566 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/589b7802680a463fadaba69e43472cd8 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/589b7802680a463fadaba69e43472cd8 2023-02-19 08:00:18,566 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/44b34a072fe145bba304be71ba6b78f4 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/44b34a072fe145bba304be71ba6b78f4 2023-02-19 08:00:18,567 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/133ee053b18c40588fc7bcb0b6b3ff7f to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/133ee053b18c40588fc7bcb0b6b3ff7f 2023-02-19 08:00:18,567 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/59d06bd46d2545bbafad43484714e879 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/59d06bd46d2545bbafad43484714e879 2023-02-19 08:00:18,569 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/79331457b80f40eb8b250226197da8b3 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/79331457b80f40eb8b250226197da8b3 2023-02-19 08:00:18,575 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/5ce664da08114312b7f9a4977214b303 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f1/5ce664da08114312b7f9a4977214b303 2023-02-19 08:00:18,575 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/bc8f887456d4466bb869e459fcf87115 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f1/bc8f887456d4466bb869e459fcf87115 2023-02-19 08:00:18,575 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/91cbf249c936421d82c86eac2c624da3 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f1/91cbf249c936421d82c86eac2c624da3 2023-02-19 08:00:18,576 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/cdf321db773f4b868e912dad1123b0be to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f1/cdf321db773f4b868e912dad1123b0be 2023-02-19 08:00:18,576 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/recovered.edits/6.seqid to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64/recovered.edits/6.seqid 2023-02-19 08:00:18,577 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/a3b4320e15ae4c7ca07165b18d66016c to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f1/a3b4320e15ae4c7ca07165b18d66016c 2023-02-19 08:00:18,577 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/735a3357f6a3e4596852ead7c0349d64 2023-02-19 08:00:18,577 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:18,577 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/920d8324838642b5af55ecda8a22b22e to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f1/920d8324838642b5af55ecda8a22b22e 2023-02-19 08:00:18,578 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/8a0508eac763454ebd4ea2a076f117e4 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f1/8a0508eac763454ebd4ea2a076f117e4 2023-02-19 08:00:18,588 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/recovered.edits] 2023-02-19 08:00:18,595 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/0f0d1b1cc1824ec88ca0038bdfdd5429 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/0f0d1b1cc1824ec88ca0038bdfdd5429 2023-02-19 08:00:18,595 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/381e109adfd64ecba07d8a593628ed63 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/381e109adfd64ecba07d8a593628ed63 2023-02-19 08:00:18,599 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/31c163741c694c398259c7c84014edc4 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/31c163741c694c398259c7c84014edc4 2023-02-19 08:00:18,599 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/2a4d0831424f46f4a0619f0a7f11b73b to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/2a4d0831424f46f4a0619f0a7f11b73b 2023-02-19 08:00:18,600 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/512876183bc64f52ac616070b2184016 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/512876183bc64f52ac616070b2184016 2023-02-19 08:00:18,601 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/207880324d71460a87aaea027bd14242 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/207880324d71460a87aaea027bd14242 2023-02-19 08:00:18,601 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/0f9375b10e2e4bba91c0cc8328bc26c3 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/0f9375b10e2e4bba91c0cc8328bc26c3 2023-02-19 08:00:18,603 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/c1559c16222c4c72b33518b0c0a0c215 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/f2/c1559c16222c4c72b33518b0c0a0c215 2023-02-19 08:00:18,603 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/e561d1145e4449be99a229b16a7ed145 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/f2/e561d1145e4449be99a229b16a7ed145 2023-02-19 08:00:18,603 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/d914a1f88c3f4fd89a07c07f072c3898 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/f2/d914a1f88c3f4fd89a07c07f072c3898 2023-02-19 08:00:18,604 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/d0e31808382c4096b884a70642fde97b to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/f2/d0e31808382c4096b884a70642fde97b 2023-02-19 08:00:18,605 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/6685626747c24ba0935e286bc59453c4 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/f2/6685626747c24ba0935e286bc59453c4 2023-02-19 08:00:18,607 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/2cc5709fb7634131a85c6a6f4f165241 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/2cc5709fb7634131a85c6a6f4f165241 2023-02-19 08:00:18,607 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/0f9a999f018f45b792da442beb18ad82 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/f2/0f9a999f018f45b792da442beb18ad82 2023-02-19 08:00:18,607 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/926d05512dab4faba9fd87eebc26ceff to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/f2/926d05512dab4faba9fd87eebc26ceff 2023-02-19 08:00:18,611 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/61dd81b3cd4c4ce882df917e5dde87e1 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f1/61dd81b3cd4c4ce882df917e5dde87e1 2023-02-19 08:00:18,613 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/recovered.edits/12.seqid to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5/recovered.edits/12.seqid 2023-02-19 08:00:18,614 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/recovered.edits/12.seqid to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b/recovered.edits/12.seqid 2023-02-19 08:00:18,614 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/recovered.edits/12.seqid to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9/recovered.edits/12.seqid 2023-02-19 08:00:18,614 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/a1c986905b4b75c76cb545a48eca56d5 2023-02-19 08:00:18,614 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:18,615 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/dcd361eae0971a2967db576c98a25ff9 2023-02-19 08:00:18,621 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/recovered.edits/12.seqid to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839/recovered.edits/12.seqid 2023-02-19 08:00:18,621 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/12f858663eed44690e97863779d6c54b 2023-02-19 08:00:18,621 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/recovered.edits/12.seqid to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658/recovered.edits/12.seqid 2023-02-19 08:00:18,621 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/recovered.edits/12.seqid to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6/recovered.edits/12.seqid 2023-02-19 08:00:18,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 08:00:18,623 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/recovered.edits/12.seqid to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0/recovered.edits/12.seqid 2023-02-19 08:00:18,624 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/41e4f80f1dcd267361d2089538740658 2023-02-19 08:00:18,624 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/377808f4fc665932de9d53239fd64839 2023-02-19 08:00:18,624 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/10266b2fcaa6ab45dac12ab3031b14e6 2023-02-19 08:00:18,624 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/9ece356a26d0f56e3e6639a5ac4967f0 2023-02-19 08:00:18,625 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/f1, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/f2, FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/recovered.edits] 2023-02-19 08:00:18,625 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/576213703fda4924bca2a7824214ea00 to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/576213703fda4924bca2a7824214ea00 2023-02-19 08:00:18,628 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/97494ed7681846a3b0e4218a3e26e16a to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/f2/97494ed7681846a3b0e4218a3e26e16a 2023-02-19 08:00:18,631 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/recovered.edits/12.seqid to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587/recovered.edits/12.seqid 2023-02-19 08:00:18,632 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/fc5a61fc9e332779e04d53df613e1587 2023-02-19 08:00:18,633 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/recovered.edits/6.seqid to hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/archive/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa/recovered.edits/6.seqid 2023-02-19 08:00:18,634 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/.tmp/data/default/testWithMapReduce/6cd2c788ffa741e22b829f8fd3df39fa 2023-02-19 08:00:18,634 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 08:00:18,637 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:18,663 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-19 08:00:18,667 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-19 08:00:18,669 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:18,669 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-19 08:00:18,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793618669"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793618669"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676793609932.12f858663eed44690e97863779d6c54b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793618669"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793618669"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793618669"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676793609932.377808f4fc665932de9d53239fd64839.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793618669"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793618669"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793618669"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793618669"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793618669"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,673 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-19 08:00:18,673 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 735a3357f6a3e4596852ead7c0349d64, NAME => 'testWithMapReduce,,1676793609932.735a3357f6a3e4596852ead7c0349d64.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 10266b2fcaa6ab45dac12ab3031b14e6, NAME => 'testWithMapReduce,aaa,1676793609932.10266b2fcaa6ab45dac12ab3031b14e6.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 12f858663eed44690e97863779d6c54b, NAME => 'testWithMapReduce,d\x84\x84,1676793609932.12f858663eed44690e97863779d6c54b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 41e4f80f1dcd267361d2089538740658, NAME => 'testWithMapReduce,g\xA7\xA7,1676793609932.41e4f80f1dcd267361d2089538740658.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => a1c986905b4b75c76cb545a48eca56d5, NAME => 'testWithMapReduce,j\xCA\xCA,1676793609932.a1c986905b4b75c76cb545a48eca56d5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 377808f4fc665932de9d53239fd64839, NAME => 'testWithMapReduce,m\xED\xED,1676793609932.377808f4fc665932de9d53239fd64839.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => dcd361eae0971a2967db576c98a25ff9, NAME => 'testWithMapReduce,q\x11\x10,1676793609932.dcd361eae0971a2967db576c98a25ff9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 9ece356a26d0f56e3e6639a5ac4967f0, NAME => 'testWithMapReduce,t43,1676793609932.9ece356a26d0f56e3e6639a5ac4967f0.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => fc5a61fc9e332779e04d53df613e1587, NAME => 'testWithMapReduce,wWV,1676793609932.fc5a61fc9e332779e04d53df613e1587.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 6cd2c788ffa741e22b829f8fd3df39fa, NAME => 'testWithMapReduce,zz{,1676793609932.6cd2c788ffa741e22b829f8fd3df39fa.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-19 08:00:18,673 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-19 08:00:18,674 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676793618673"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:18,675 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-19 08:00:18,677 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:18,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 169 msec 2023-02-19 08:00:18,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32887] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 08:00:18,824 INFO [Listener at localhost/37093] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-19 08:00:18,824 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 08:00:18,824 INFO [Listener at localhost/37093] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 08:00:18,824 DEBUG [Listener at localhost/37093] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10cc2535 to 127.0.0.1:57971 2023-02-19 08:00:18,825 DEBUG [Listener at localhost/37093] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:18,825 DEBUG [Listener at localhost/37093] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 08:00:18,825 DEBUG [Listener at localhost/37093] util.JVMClusterUtil(257): Found active master hash=827159242, stopped=false 2023-02-19 08:00:18,825 INFO [Listener at localhost/37093] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,32887,1676793604664 2023-02-19 08:00:18,828 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:18,828 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:18,828 INFO [Listener at localhost/37093] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 08:00:18,828 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:18,828 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:18,829 DEBUG [Listener at localhost/37093] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22278d21 to 127.0.0.1:57971 2023-02-19 08:00:18,829 DEBUG [Listener at localhost/37093] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:18,829 INFO [Listener at localhost/37093] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43525,1676793605916' ***** 2023-02-19 08:00:18,829 INFO [Listener at localhost/37093] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:18,830 INFO [Listener at localhost/37093] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35991,1676793605965' ***** 2023-02-19 08:00:18,830 INFO [Listener at localhost/37093] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:18,830 INFO [RS:1;jenkins-hbase4:35991] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:18,830 INFO [RS:1;jenkins-hbase4:35991] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:18,830 INFO [RS:0;jenkins-hbase4:43525] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:18,830 INFO [RS:0;jenkins-hbase4:43525] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:18,830 INFO [RS:1;jenkins-hbase4:35991] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:18,830 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:18,831 INFO [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:18,830 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:18,831 DEBUG [RS:1;jenkins-hbase4:35991] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17d1ae5e to 127.0.0.1:57971 2023-02-19 08:00:18,830 INFO [RS:0;jenkins-hbase4:43525] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:18,831 DEBUG [RS:1;jenkins-hbase4:35991] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:18,831 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(3304): Received CLOSE for bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:18,832 INFO [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35991,1676793605965; all regions closed. 2023-02-19 08:00:18,832 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:18,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:18,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:18,832 DEBUG [RS:0;jenkins-hbase4:43525] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10a01dde to 127.0.0.1:57971 2023-02-19 08:00:18,833 DEBUG [RS:0;jenkins-hbase4:43525] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:18,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bdb320c7b86679caae80508e68d9800b, disabling compactions & flushes 2023-02-19 08:00:18,833 INFO [RS:0;jenkins-hbase4:43525] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:18,833 INFO [RS:0;jenkins-hbase4:43525] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:18,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:18,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:18,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. after waiting 0 ms 2023-02-19 08:00:18,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:18,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing bdb320c7b86679caae80508e68d9800b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 08:00:18,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:18,833 INFO [RS:0;jenkins-hbase4:43525] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:18,836 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 08:00:18,836 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-19 08:00:18,836 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1479): Online Regions={bdb320c7b86679caae80508e68d9800b=hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b., 1588230740=hbase:meta,,1.1588230740} 2023-02-19 08:00:18,838 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1505): Waiting on 1588230740, bdb320c7b86679caae80508e68d9800b 2023-02-19 08:00:18,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:18,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:18,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:18,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:18,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:18,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-19 08:00:18,842 DEBUG [RS:1;jenkins-hbase4:35991] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/oldWALs 2023-02-19 08:00:18,842 INFO [RS:1;jenkins-hbase4:35991] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35991%2C1676793605965:(num 1676793609483) 2023-02-19 08:00:18,842 DEBUG [RS:1;jenkins-hbase4:35991] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:18,842 INFO [RS:1;jenkins-hbase4:35991] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:18,842 INFO [RS:1;jenkins-hbase4:35991] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:18,842 INFO [RS:1;jenkins-hbase4:35991] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:18,842 INFO [RS:1;jenkins-hbase4:35991] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:18,842 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:18,842 INFO [RS:1;jenkins-hbase4:35991] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:18,844 INFO [RS:1;jenkins-hbase4:35991] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35991 2023-02-19 08:00:18,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b/.tmp/info/af8762e670404bde8e3a8ab687406b67 2023-02-19 08:00:18,872 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/.tmp/info/88014a027da944ae8272dbfaf0c0e39c 2023-02-19 08:00:18,872 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:18,872 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:18,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88014a027da944ae8272dbfaf0c0e39c 2023-02-19 08:00:18,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b/.tmp/info/af8762e670404bde8e3a8ab687406b67 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b/info/af8762e670404bde8e3a8ab687406b67 2023-02-19 08:00:18,915 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/.tmp/rep_barrier/bbff2dab0b404c17b20142c445f6e014 2023-02-19 08:00:18,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b/info/af8762e670404bde8e3a8ab687406b67, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 08:00:18,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for bdb320c7b86679caae80508e68d9800b in 85ms, sequenceid=6, compaction requested=false 2023-02-19 08:00:18,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbff2dab0b404c17b20142c445f6e014 2023-02-19 08:00:18,946 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:18,946 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:18,946 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35991,1676793605965 2023-02-19 08:00:18,946 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:18,957 ERROR [Listener at localhost/37093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e972b99 rejected from java.util.concurrent.ThreadPoolExecutor@3aa8b893[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:18,957 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:18,957 ERROR [Listener at localhost/37093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@49d33a7f rejected from java.util.concurrent.ThreadPoolExecutor@3aa8b893[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:18,957 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35991,1676793605965] 2023-02-19 08:00:18,957 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35991,1676793605965; numProcessing=1 2023-02-19 08:00:18,959 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35991,1676793605965 already deleted, retry=false 2023-02-19 08:00:18,959 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35991,1676793605965 expired; onlineServers=1 2023-02-19 08:00:18,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/namespace/bdb320c7b86679caae80508e68d9800b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 08:00:18,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:18,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bdb320c7b86679caae80508e68d9800b: 2023-02-19 08:00:18,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676793609065.bdb320c7b86679caae80508e68d9800b. 2023-02-19 08:00:18,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/.tmp/table/20bdbbfd1b554a89b839b731682c5231 2023-02-19 08:00:19,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20bdbbfd1b554a89b839b731682c5231 2023-02-19 08:00:19,001 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/.tmp/info/88014a027da944ae8272dbfaf0c0e39c as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/info/88014a027da944ae8272dbfaf0c0e39c 2023-02-19 08:00:19,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88014a027da944ae8272dbfaf0c0e39c 2023-02-19 08:00:19,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/info/88014a027da944ae8272dbfaf0c0e39c, entries=30, sequenceid=57, filesize=7.9 K 2023-02-19 08:00:19,010 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/.tmp/rep_barrier/bbff2dab0b404c17b20142c445f6e014 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/rep_barrier/bbff2dab0b404c17b20142c445f6e014 2023-02-19 08:00:19,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbff2dab0b404c17b20142c445f6e014 2023-02-19 08:00:19,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/rep_barrier/bbff2dab0b404c17b20142c445f6e014, entries=10, sequenceid=57, filesize=5.9 K 2023-02-19 08:00:19,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/.tmp/table/20bdbbfd1b554a89b839b731682c5231 as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/table/20bdbbfd1b554a89b839b731682c5231 2023-02-19 08:00:19,038 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20bdbbfd1b554a89b839b731682c5231 2023-02-19 08:00:19,038 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/table/20bdbbfd1b554a89b839b731682c5231, entries=13, sequenceid=57, filesize=5.9 K 2023-02-19 08:00:19,038 DEBUG [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 08:00:19,039 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 200ms, sequenceid=57, compaction requested=false 2023-02-19 08:00:19,065 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:19,065 INFO [RS:1;jenkins-hbase4:35991] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35991,1676793605965; zookeeper connection closed. 2023-02-19 08:00:19,065 ERROR [Listener at localhost/37093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@318c5e4f rejected from java.util.concurrent.ThreadPoolExecutor@3aa8b893[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:19,065 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:35991-0x1006b97d0630002, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:19,065 ERROR [Listener at localhost/37093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f551fa0 rejected from java.util.concurrent.ThreadPoolExecutor@3aa8b893[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:19,069 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5baa4258] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5baa4258 2023-02-19 08:00:19,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-19 08:00:19,071 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 08:00:19,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:19,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:19,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:19,238 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43525,1676793605916; all regions closed. 2023-02-19 08:00:19,245 DEBUG [RS:0;jenkins-hbase4:43525] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/oldWALs 2023-02-19 08:00:19,246 INFO [RS:0;jenkins-hbase4:43525] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43525%2C1676793605916.meta:.meta(num 1676793608799) 2023-02-19 08:00:19,252 DEBUG [RS:0;jenkins-hbase4:43525] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/oldWALs 2023-02-19 08:00:19,252 INFO [RS:0;jenkins-hbase4:43525] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43525%2C1676793605916:(num 1676793609483) 2023-02-19 08:00:19,252 DEBUG [RS:0;jenkins-hbase4:43525] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:19,252 INFO [RS:0;jenkins-hbase4:43525] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:19,253 INFO [RS:0;jenkins-hbase4:43525] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:19,254 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:19,255 INFO [RS:0;jenkins-hbase4:43525] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43525 2023-02-19 08:00:19,258 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:19,258 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43525,1676793605916 2023-02-19 08:00:19,259 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43525,1676793605916] 2023-02-19 08:00:19,259 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43525,1676793605916; numProcessing=2 2023-02-19 08:00:19,261 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43525,1676793605916 already deleted, retry=false 2023-02-19 08:00:19,261 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43525,1676793605916 expired; onlineServers=0 2023-02-19 08:00:19,261 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32887,1676793604664' ***** 2023-02-19 08:00:19,261 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 08:00:19,262 DEBUG [M:0;jenkins-hbase4:32887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@707078f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:19,262 INFO [M:0;jenkins-hbase4:32887] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32887,1676793604664 2023-02-19 08:00:19,262 INFO [M:0;jenkins-hbase4:32887] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32887,1676793604664; all regions closed. 2023-02-19 08:00:19,262 DEBUG [M:0;jenkins-hbase4:32887] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:19,262 DEBUG [M:0;jenkins-hbase4:32887] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 08:00:19,262 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 08:00:19,262 DEBUG [M:0;jenkins-hbase4:32887] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 08:00:19,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793607271] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793607271,5,FailOnTimeoutGroup] 2023-02-19 08:00:19,262 INFO [M:0;jenkins-hbase4:32887] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 08:00:19,263 INFO [M:0;jenkins-hbase4:32887] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 08:00:19,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793607271] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793607271,5,FailOnTimeoutGroup] 2023-02-19 08:00:19,264 INFO [M:0;jenkins-hbase4:32887] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 08:00:19,264 DEBUG [M:0;jenkins-hbase4:32887] master.HMaster(1512): Stopping service threads 2023-02-19 08:00:19,264 INFO [M:0;jenkins-hbase4:32887] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 08:00:19,266 ERROR [M:0;jenkins-hbase4:32887] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-19 08:00:19,267 INFO [M:0;jenkins-hbase4:32887] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 08:00:19,267 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 08:00:19,270 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:19,270 DEBUG [M:0;jenkins-hbase4:32887] zookeeper.ZKUtil(398): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 08:00:19,270 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:19,270 WARN [M:0;jenkins-hbase4:32887] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 08:00:19,270 INFO [M:0;jenkins-hbase4:32887] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 08:00:19,270 INFO [M:0;jenkins-hbase4:32887] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 08:00:19,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:19,271 DEBUG [M:0;jenkins-hbase4:32887] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:19,271 INFO [M:0;jenkins-hbase4:32887] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:19,271 DEBUG [M:0;jenkins-hbase4:32887] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:19,271 DEBUG [M:0;jenkins-hbase4:32887] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:19,271 DEBUG [M:0;jenkins-hbase4:32887] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:19,271 INFO [M:0;jenkins-hbase4:32887] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.25 KB heapSize=192.17 KB 2023-02-19 08:00:19,285 INFO [M:0;jenkins-hbase4:32887] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.25 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/46824f7f6f934e01a21b2ac5ef84b5fa 2023-02-19 08:00:19,292 DEBUG [M:0;jenkins-hbase4:32887] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/46824f7f6f934e01a21b2ac5ef84b5fa as hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/46824f7f6f934e01a21b2ac5ef84b5fa 2023-02-19 08:00:19,298 INFO [M:0;jenkins-hbase4:32887] regionserver.HStore(1080): Added hdfs://localhost:33697/user/jenkins/test-data/c563247b-5d31-a244-c71b-191db37c8c48/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/46824f7f6f934e01a21b2ac5ef84b5fa, entries=53, sequenceid=357, filesize=10.4 K 2023-02-19 08:00:19,299 INFO [M:0;jenkins-hbase4:32887] regionserver.HRegion(2947): Finished flush of dataSize ~159.25 KB/163067, heapSize ~192.16 KB/196768, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=357, compaction requested=false 2023-02-19 08:00:19,300 INFO [M:0;jenkins-hbase4:32887] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:19,300 DEBUG [M:0;jenkins-hbase4:32887] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:19,309 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:19,309 INFO [M:0;jenkins-hbase4:32887] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 08:00:19,310 INFO [M:0;jenkins-hbase4:32887] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32887 2023-02-19 08:00:19,313 DEBUG [M:0;jenkins-hbase4:32887] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,32887,1676793604664 already deleted, retry=false 2023-02-19 08:00:19,360 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:19,360 INFO [RS:0;jenkins-hbase4:43525] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43525,1676793605916; zookeeper connection closed. 2023-02-19 08:00:19,360 ERROR [Listener at localhost/37093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40561a91 rejected from java.util.concurrent.ThreadPoolExecutor@44699643[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:19,360 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): regionserver:43525-0x1006b97d0630001, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:19,360 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c80a45] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c80a45 2023-02-19 08:00:19,361 ERROR [Listener at localhost/37093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40520dd1 rejected from java.util.concurrent.ThreadPoolExecutor@44699643[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:19,361 INFO [Listener at localhost/37093] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 08:00:19,460 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:19,460 INFO [M:0;jenkins-hbase4:32887] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32887,1676793604664; zookeeper connection closed. 2023-02-19 08:00:19,460 ERROR [Listener at localhost/37093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60e96ebe rejected from java.util.concurrent.ThreadPoolExecutor@753cbc3a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:19,461 DEBUG [Listener at localhost/37093-EventThread] zookeeper.ZKWatcher(600): master:32887-0x1006b97d0630000, quorum=127.0.0.1:57971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:19,461 ERROR [Listener at localhost/37093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@554296f6 rejected from java.util.concurrent.ThreadPoolExecutor@753cbc3a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:19,463 WARN [Listener at localhost/37093] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:19,468 INFO [Listener at localhost/37093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:19,485 WARN [BP-1406005921-172.31.14.131-1676793601182 heartbeating to localhost/127.0.0.1:33697] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:19,486 WARN [BP-1406005921-172.31.14.131-1676793601182 heartbeating to localhost/127.0.0.1:33697] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1406005921-172.31.14.131-1676793601182 (Datanode Uuid d7c6b436-5136-4b2b-886e-872415f736db) service to localhost/127.0.0.1:33697 2023-02-19 08:00:19,488 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/cluster_b403e41a-8096-f14e-29d8-fd2298438252/dfs/data/data3/current/BP-1406005921-172.31.14.131-1676793601182] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:19,488 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/cluster_b403e41a-8096-f14e-29d8-fd2298438252/dfs/data/data4/current/BP-1406005921-172.31.14.131-1676793601182] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:19,490 WARN [Listener at localhost/37093] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:19,505 INFO [Listener at localhost/37093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:19,609 WARN [BP-1406005921-172.31.14.131-1676793601182 heartbeating to localhost/127.0.0.1:33697] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:19,609 WARN [BP-1406005921-172.31.14.131-1676793601182 heartbeating to localhost/127.0.0.1:33697] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1406005921-172.31.14.131-1676793601182 (Datanode Uuid c5141124-e15d-46f4-9cff-5c91d1131c3f) service to localhost/127.0.0.1:33697 2023-02-19 08:00:19,609 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/cluster_b403e41a-8096-f14e-29d8-fd2298438252/dfs/data/data1/current/BP-1406005921-172.31.14.131-1676793601182] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:19,610 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/cluster_b403e41a-8096-f14e-29d8-fd2298438252/dfs/data/data2/current/BP-1406005921-172.31.14.131-1676793601182] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:19,642 INFO [Listener at localhost/37093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:19,762 INFO [Listener at localhost/37093] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 08:00:19,858 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 08:00:19,878 INFO [Listener at localhost/37093] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33697 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37093 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,32887,1676793604664)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:33697 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:33697 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:33697 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@13481f4f java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:33697 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:33697 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:33697 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) - Thread LEAK? -, OpenFileDescriptor=539 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=341 (was 241) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=10001 (was 11464) 2023-02-19 08:00:19,891 INFO [Listener at localhost/37093] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=539, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=170, AvailableMemoryMB=9999 2023-02-19 08:00:19,905 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/hadoop.log.dir so I do NOT create it in target/test-data/9f655639-dc65-d822-8726-136211c882de 2023-02-19 08:00:19,905 WARN [Listener at localhost/37093] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 08:00:19,905 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/hadoop.tmp.dir so I do NOT create it in target/test-data/9f655639-dc65-d822-8726-136211c882de 2023-02-19 08:00:19,905 WARN [Listener at localhost/37093] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0a6ba567-1234-b899-198c-43df02f73cf0/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 08:00:19,905 DEBUG [Listener at localhost/37093] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de 2023-02-19 08:00:19,905 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 08:00:19,905 INFO [Listener at localhost/37093] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/cluster_1f3c0ce0-6f1b-8ef9-4e13-dac23946ce5c, deleteOnExit=true 2023-02-19 08:00:19,906 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 08:00:19,906 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/test.cache.data in system properties and HBase conf 2023-02-19 08:00:19,906 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 08:00:19,906 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/hadoop.log.dir in system properties and HBase conf 2023-02-19 08:00:19,906 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 08:00:19,906 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 08:00:19,906 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 08:00:19,906 DEBUG [Listener at localhost/37093] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 08:00:19,906 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:19,907 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:19,907 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 08:00:19,907 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:19,907 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 08:00:19,907 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 08:00:19,907 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:19,907 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:19,907 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 08:00:19,907 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/nfs.dump.dir in system properties and HBase conf 2023-02-19 08:00:19,907 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/java.io.tmpdir in system properties and HBase conf 2023-02-19 08:00:19,908 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:19,908 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 08:00:19,908 INFO [Listener at localhost/37093] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 08:00:19,912 WARN [Listener at localhost/37093] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:19,912 WARN [Listener at localhost/37093] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:19,961 WARN [Listener at localhost/37093] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:19,963 INFO [Listener at localhost/37093] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:19,970 INFO [Listener at localhost/37093] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/java.io.tmpdir/Jetty_localhost_37197_hdfs____98bbv9/webapp 2023-02-19 08:00:20,093 INFO [Listener at localhost/37093] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37197 2023-02-19 08:00:20,097 WARN [Listener at localhost/37093] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:20,098 WARN [Listener at localhost/37093] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:20,144 WARN [Listener at localhost/39511] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:20,163 WARN [Listener at localhost/39511] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:20,165 WARN [Listener at localhost/39511] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:20,167 INFO [Listener at localhost/39511] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:20,172 INFO [Listener at localhost/39511] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/java.io.tmpdir/Jetty_localhost_43789_datanode____.j96zuo/webapp 2023-02-19 08:00:20,264 INFO [Listener at localhost/39511] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43789 2023-02-19 08:00:20,271 WARN [Listener at localhost/43503] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:20,286 WARN [Listener at localhost/43503] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:20,288 WARN [Listener at localhost/43503] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:20,289 INFO [Listener at localhost/43503] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:20,297 INFO [Listener at localhost/43503] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/java.io.tmpdir/Jetty_localhost_42525_datanode____8wd80x/webapp 2023-02-19 08:00:20,391 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfe741596c15548a8: Processing first storage report for DS-d5e2e394-d5b7-4d16-aafa-ba88ece19815 from datanode c7452db0-d8e3-4210-b8fd-e54ec4ca32dc 2023-02-19 08:00:20,391 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfe741596c15548a8: from storage DS-d5e2e394-d5b7-4d16-aafa-ba88ece19815 node DatanodeRegistration(127.0.0.1:35313, datanodeUuid=c7452db0-d8e3-4210-b8fd-e54ec4ca32dc, infoPort=42219, infoSecurePort=0, ipcPort=43503, storageInfo=lv=-57;cid=testClusterID;nsid=222010620;c=1676793619915), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:20,391 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfe741596c15548a8: Processing first storage report for DS-f1623693-ad3f-405c-9a65-503cd649da97 from datanode c7452db0-d8e3-4210-b8fd-e54ec4ca32dc 2023-02-19 08:00:20,391 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfe741596c15548a8: from storage DS-f1623693-ad3f-405c-9a65-503cd649da97 node DatanodeRegistration(127.0.0.1:35313, datanodeUuid=c7452db0-d8e3-4210-b8fd-e54ec4ca32dc, infoPort=42219, infoSecurePort=0, ipcPort=43503, storageInfo=lv=-57;cid=testClusterID;nsid=222010620;c=1676793619915), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:20,411 INFO [Listener at localhost/43503] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42525 2023-02-19 08:00:20,428 WARN [Listener at localhost/39595] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:20,532 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbd3e1e6230cfe597: Processing first storage report for DS-f1800b05-7d3c-4a26-a821-52a1a26ce4fb from datanode e07f2d53-c7d0-48e2-aeae-dd8fdda1065e 2023-02-19 08:00:20,532 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbd3e1e6230cfe597: from storage DS-f1800b05-7d3c-4a26-a821-52a1a26ce4fb node DatanodeRegistration(127.0.0.1:35097, datanodeUuid=e07f2d53-c7d0-48e2-aeae-dd8fdda1065e, infoPort=32771, infoSecurePort=0, ipcPort=39595, storageInfo=lv=-57;cid=testClusterID;nsid=222010620;c=1676793619915), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:20,534 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbd3e1e6230cfe597: Processing first storage report for DS-caa31b9d-0805-4761-87f3-89adf83082e1 from datanode e07f2d53-c7d0-48e2-aeae-dd8fdda1065e 2023-02-19 08:00:20,534 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbd3e1e6230cfe597: from storage DS-caa31b9d-0805-4761-87f3-89adf83082e1 node DatanodeRegistration(127.0.0.1:35097, datanodeUuid=e07f2d53-c7d0-48e2-aeae-dd8fdda1065e, infoPort=32771, infoSecurePort=0, ipcPort=39595, storageInfo=lv=-57;cid=testClusterID;nsid=222010620;c=1676793619915), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:20,539 DEBUG [Listener at localhost/39595] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de 2023-02-19 08:00:20,544 INFO [Listener at localhost/39595] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/cluster_1f3c0ce0-6f1b-8ef9-4e13-dac23946ce5c/zookeeper_0, clientPort=57467, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/cluster_1f3c0ce0-6f1b-8ef9-4e13-dac23946ce5c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/cluster_1f3c0ce0-6f1b-8ef9-4e13-dac23946ce5c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 08:00:20,549 INFO [Listener at localhost/39595] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57467 2023-02-19 08:00:20,549 INFO [Listener at localhost/39595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,551 INFO [Listener at localhost/39595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,583 INFO [Listener at localhost/39595] util.FSUtils(479): Created version file at hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14 with version=8 2023-02-19 08:00:20,584 INFO [Listener at localhost/39595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,585 INFO [Listener at localhost/39595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,587 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/hbase-staging 2023-02-19 08:00:20,589 INFO [Listener at localhost/39595] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:20,589 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:20,589 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:20,590 INFO [Listener at localhost/39595] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:20,590 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:20,590 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:20,590 INFO [Listener at localhost/39595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:20,592 INFO [Listener at localhost/39595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40875 2023-02-19 08:00:20,593 INFO [Listener at localhost/39595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,594 INFO [Listener at localhost/39595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,595 INFO [Listener at localhost/39595] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40875 connecting to ZooKeeper ensemble=127.0.0.1:57467 2023-02-19 08:00:20,609 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:408750x0, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:20,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40875-0x1006b9812040000 connected 2023-02-19 08:00:20,631 DEBUG [Listener at localhost/39595] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:20,632 DEBUG [Listener at localhost/39595] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:20,632 DEBUG [Listener at localhost/39595] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:20,636 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40875 2023-02-19 08:00:20,637 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40875 2023-02-19 08:00:20,638 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40875 2023-02-19 08:00:20,640 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40875 2023-02-19 08:00:20,640 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40875 2023-02-19 08:00:20,640 INFO [Listener at localhost/39595] master.HMaster(444): hbase.rootdir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14, hbase.cluster.distributed=false 2023-02-19 08:00:20,657 INFO [Listener at localhost/39595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:20,657 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:20,657 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:20,657 INFO [Listener at localhost/39595] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:20,657 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:20,657 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:20,657 INFO [Listener at localhost/39595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:20,661 INFO [Listener at localhost/39595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34367 2023-02-19 08:00:20,661 INFO [Listener at localhost/39595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:20,664 DEBUG [Listener at localhost/39595] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:20,665 INFO [Listener at localhost/39595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,666 INFO [Listener at localhost/39595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,667 INFO [Listener at localhost/39595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34367 connecting to ZooKeeper ensemble=127.0.0.1:57467 2023-02-19 08:00:20,670 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:343670x0, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:20,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34367-0x1006b9812040001 connected 2023-02-19 08:00:20,671 DEBUG [Listener at localhost/39595] zookeeper.ZKUtil(164): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:20,671 DEBUG [Listener at localhost/39595] zookeeper.ZKUtil(164): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:20,672 DEBUG [Listener at localhost/39595] zookeeper.ZKUtil(164): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:20,675 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34367 2023-02-19 08:00:20,676 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34367 2023-02-19 08:00:20,677 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34367 2023-02-19 08:00:20,679 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34367 2023-02-19 08:00:20,680 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34367 2023-02-19 08:00:20,693 INFO [Listener at localhost/39595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:20,693 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:20,693 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:20,693 INFO [Listener at localhost/39595] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:20,693 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:20,693 INFO [Listener at localhost/39595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:20,693 INFO [Listener at localhost/39595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:20,696 INFO [Listener at localhost/39595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43395 2023-02-19 08:00:20,696 INFO [Listener at localhost/39595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:20,697 DEBUG [Listener at localhost/39595] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:20,698 INFO [Listener at localhost/39595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,699 INFO [Listener at localhost/39595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,700 INFO [Listener at localhost/39595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43395 connecting to ZooKeeper ensemble=127.0.0.1:57467 2023-02-19 08:00:20,704 DEBUG [Listener at localhost/39595] zookeeper.ZKUtil(164): regionserver:433950x0, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:20,704 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:433950x0, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:20,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43395-0x1006b9812040002 connected 2023-02-19 08:00:20,705 DEBUG [Listener at localhost/39595] zookeeper.ZKUtil(164): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:20,706 DEBUG [Listener at localhost/39595] zookeeper.ZKUtil(164): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:20,707 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43395 2023-02-19 08:00:20,707 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43395 2023-02-19 08:00:20,707 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43395 2023-02-19 08:00:20,709 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43395 2023-02-19 08:00:20,710 DEBUG [Listener at localhost/39595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43395 2023-02-19 08:00:20,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40875,1676793620588 2023-02-19 08:00:20,712 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:20,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40875,1676793620588 2023-02-19 08:00:20,715 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:20,715 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:20,716 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:20,716 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:20,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:20,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40875,1676793620588 from backup master directory 2023-02-19 08:00:20,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:20,720 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40875,1676793620588 2023-02-19 08:00:20,720 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:20,720 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:20,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40875,1676793620588 2023-02-19 08:00:20,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/hbase.id with ID: ac6dd56f-4bd7-4075-9ca6-4115bfefc6fb 2023-02-19 08:00:20,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:20,754 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:20,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x096b2500 to 127.0.0.1:57467 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:20,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b32cd85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:20,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:20,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 08:00:20,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:20,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/data/master/store-tmp 2023-02-19 08:00:20,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:20,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:20,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:20,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:20,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:20,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:20,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:20,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:20,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/WALs/jenkins-hbase4.apache.org,40875,1676793620588 2023-02-19 08:00:20,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40875%2C1676793620588, suffix=, logDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/WALs/jenkins-hbase4.apache.org,40875,1676793620588, archiveDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/oldWALs, maxLogs=10 2023-02-19 08:00:20,797 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35313,DS-d5e2e394-d5b7-4d16-aafa-ba88ece19815,DISK] 2023-02-19 08:00:20,798 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35097,DS-f1800b05-7d3c-4a26-a821-52a1a26ce4fb,DISK] 2023-02-19 08:00:20,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/WALs/jenkins-hbase4.apache.org,40875,1676793620588/jenkins-hbase4.apache.org%2C40875%2C1676793620588.1676793620781 2023-02-19 08:00:20,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35313,DS-d5e2e394-d5b7-4d16-aafa-ba88ece19815,DISK], DatanodeInfoWithStorage[127.0.0.1:35097,DS-f1800b05-7d3c-4a26-a821-52a1a26ce4fb,DISK]] 2023-02-19 08:00:20,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:20,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:20,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:20,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:20,805 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:20,806 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 08:00:20,807 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 08:00:20,807 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:20,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:20,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:20,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:20,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:20,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64000273, jitterRate=-0.04632161557674408}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:20,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:20,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 08:00:20,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 08:00:20,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 08:00:20,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 08:00:20,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 08:00:20,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 08:00:20,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 08:00:20,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 08:00:20,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 08:00:20,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 08:00:20,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 08:00:20,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 08:00:20,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 08:00:20,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 08:00:20,839 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:20,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 08:00:20,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 08:00:20,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 08:00:20,842 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:20,842 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:20,842 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:20,842 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:20,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40875,1676793620588, sessionid=0x1006b9812040000, setting cluster-up flag (Was=false) 2023-02-19 08:00:20,847 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:20,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 08:00:20,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40875,1676793620588 2023-02-19 08:00:20,858 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:20,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 08:00:20,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40875,1676793620588 2023-02-19 08:00:20,864 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.hbase-snapshot/.tmp 2023-02-19 08:00:20,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:20,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:20,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:20,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:20,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:20,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 08:00:20,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:20,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676793650872 2023-02-19 08:00:20,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 08:00:20,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 08:00:20,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 08:00:20,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 08:00:20,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 08:00:20,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 08:00:20,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,873 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:20,873 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 08:00:20,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 08:00:20,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 08:00:20,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 08:00:20,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 08:00:20,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 08:00:20,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793620875,5,FailOnTimeoutGroup] 2023-02-19 08:00:20,875 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:20,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793620875,5,FailOnTimeoutGroup] 2023-02-19 08:00:20,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 08:00:20,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,889 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:20,889 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:20,890 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14 2023-02-19 08:00:20,899 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:20,900 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:20,901 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/info 2023-02-19 08:00:20,902 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:20,902 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:20,903 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:20,904 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:20,904 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:20,905 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:20,905 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:20,906 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/table 2023-02-19 08:00:20,906 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:20,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:20,907 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740 2023-02-19 08:00:20,908 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740 2023-02-19 08:00:20,910 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:20,912 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:20,912 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(952): ClusterId : ac6dd56f-4bd7-4075-9ca6-4115bfefc6fb 2023-02-19 08:00:20,912 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(952): ClusterId : ac6dd56f-4bd7-4075-9ca6-4115bfefc6fb 2023-02-19 08:00:20,912 DEBUG [RS:1;jenkins-hbase4:43395] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:20,912 DEBUG [RS:0;jenkins-hbase4:34367] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:20,914 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:20,914 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68057412, jitterRate=0.014134466648101807}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:20,914 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:20,914 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:20,914 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:20,914 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:20,914 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:20,914 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:20,915 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:20,915 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:20,915 DEBUG [RS:0;jenkins-hbase4:34367] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:20,915 DEBUG [RS:1;jenkins-hbase4:43395] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:20,915 DEBUG [RS:0;jenkins-hbase4:34367] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:20,915 DEBUG [RS:1;jenkins-hbase4:43395] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:20,916 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:20,916 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 08:00:20,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 08:00:20,918 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 08:00:20,919 DEBUG [RS:0;jenkins-hbase4:34367] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:20,920 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 08:00:20,920 DEBUG [RS:0;jenkins-hbase4:34367] zookeeper.ReadOnlyZKClient(139): Connect 0x13652343 to 127.0.0.1:57467 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:20,920 DEBUG [RS:1;jenkins-hbase4:43395] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:20,922 DEBUG [RS:1;jenkins-hbase4:43395] zookeeper.ReadOnlyZKClient(139): Connect 0x000ffd1a to 127.0.0.1:57467 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:20,928 DEBUG [RS:0;jenkins-hbase4:34367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1da2df5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:20,928 DEBUG [RS:1;jenkins-hbase4:43395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ec8036b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:20,928 DEBUG [RS:0;jenkins-hbase4:34367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@199d4833, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:20,928 DEBUG [RS:1;jenkins-hbase4:43395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@af7966a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:20,938 DEBUG [RS:1;jenkins-hbase4:43395] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43395 2023-02-19 08:00:20,938 INFO [RS:1;jenkins-hbase4:43395] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:20,938 INFO [RS:1;jenkins-hbase4:43395] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:20,938 DEBUG [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:20,938 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40875,1676793620588 with isa=jenkins-hbase4.apache.org/172.31.14.131:43395, startcode=1676793620692 2023-02-19 08:00:20,938 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34367 2023-02-19 08:00:20,939 INFO [RS:0;jenkins-hbase4:34367] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:20,939 DEBUG [RS:1;jenkins-hbase4:43395] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:20,939 INFO [RS:0;jenkins-hbase4:34367] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:20,939 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:20,939 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40875,1676793620588 with isa=jenkins-hbase4.apache.org/172.31.14.131:34367, startcode=1676793620656 2023-02-19 08:00:20,939 DEBUG [RS:0;jenkins-hbase4:34367] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:20,943 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46947, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:20,943 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33729, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:20,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40875] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:20,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:20,945 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14 2023-02-19 08:00:20,945 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39511 2023-02-19 08:00:20,945 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:20,945 DEBUG [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14 2023-02-19 08:00:20,945 DEBUG [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39511 2023-02-19 08:00:20,945 DEBUG [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:20,946 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:20,950 DEBUG [RS:0;jenkins-hbase4:34367] zookeeper.ZKUtil(162): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:20,951 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34367,1676793620656] 2023-02-19 08:00:20,951 DEBUG [RS:1;jenkins-hbase4:43395] zookeeper.ZKUtil(162): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:20,951 WARN [RS:0;jenkins-hbase4:34367] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:20,951 WARN [RS:1;jenkins-hbase4:43395] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:20,951 INFO [RS:0;jenkins-hbase4:34367] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:20,951 INFO [RS:1;jenkins-hbase4:43395] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:20,951 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/WALs/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:20,951 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43395,1676793620692] 2023-02-19 08:00:20,951 DEBUG [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/WALs/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:20,956 DEBUG [RS:1;jenkins-hbase4:43395] zookeeper.ZKUtil(162): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:20,957 DEBUG [RS:0;jenkins-hbase4:34367] zookeeper.ZKUtil(162): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:20,957 DEBUG [RS:1;jenkins-hbase4:43395] zookeeper.ZKUtil(162): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:20,957 DEBUG [RS:0;jenkins-hbase4:34367] zookeeper.ZKUtil(162): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:20,958 DEBUG [RS:1;jenkins-hbase4:43395] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:20,958 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:20,958 INFO [RS:1;jenkins-hbase4:43395] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:20,958 INFO [RS:0;jenkins-hbase4:34367] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:20,959 INFO [RS:1;jenkins-hbase4:43395] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:20,960 INFO [RS:1;jenkins-hbase4:43395] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:20,960 INFO [RS:1;jenkins-hbase4:43395] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,960 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:20,961 INFO [RS:0;jenkins-hbase4:34367] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:20,961 INFO [RS:1;jenkins-hbase4:43395] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,961 INFO [RS:0;jenkins-hbase4:34367] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:20,961 INFO [RS:0;jenkins-hbase4:34367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,961 DEBUG [RS:1;jenkins-hbase4:43395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,962 DEBUG [RS:1;jenkins-hbase4:43395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,962 DEBUG [RS:1;jenkins-hbase4:43395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,962 DEBUG [RS:1;jenkins-hbase4:43395] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,962 DEBUG [RS:1;jenkins-hbase4:43395] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,962 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:20,962 DEBUG [RS:1;jenkins-hbase4:43395] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:20,962 DEBUG [RS:1;jenkins-hbase4:43395] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,963 DEBUG [RS:1;jenkins-hbase4:43395] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,963 DEBUG [RS:1;jenkins-hbase4:43395] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,963 DEBUG [RS:1;jenkins-hbase4:43395] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,964 INFO [RS:0;jenkins-hbase4:34367] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,964 DEBUG [RS:0;jenkins-hbase4:34367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,964 INFO [RS:1;jenkins-hbase4:43395] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,964 DEBUG [RS:0;jenkins-hbase4:34367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,965 INFO [RS:1;jenkins-hbase4:43395] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,965 DEBUG [RS:0;jenkins-hbase4:34367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,965 INFO [RS:1;jenkins-hbase4:43395] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,965 DEBUG [RS:0;jenkins-hbase4:34367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,965 DEBUG [RS:0;jenkins-hbase4:34367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,965 DEBUG [RS:0;jenkins-hbase4:34367] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:20,965 DEBUG [RS:0;jenkins-hbase4:34367] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,965 DEBUG [RS:0;jenkins-hbase4:34367] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,965 DEBUG [RS:0;jenkins-hbase4:34367] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,965 DEBUG [RS:0;jenkins-hbase4:34367] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:20,966 INFO [RS:0;jenkins-hbase4:34367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,966 INFO [RS:0;jenkins-hbase4:34367] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,966 INFO [RS:0;jenkins-hbase4:34367] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,976 INFO [RS:1;jenkins-hbase4:43395] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:20,976 INFO [RS:1;jenkins-hbase4:43395] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43395,1676793620692-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,978 INFO [RS:0;jenkins-hbase4:34367] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:20,978 INFO [RS:0;jenkins-hbase4:34367] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34367,1676793620656-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:20,986 INFO [RS:1;jenkins-hbase4:43395] regionserver.Replication(203): jenkins-hbase4.apache.org,43395,1676793620692 started 2023-02-19 08:00:20,986 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43395,1676793620692, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43395, sessionid=0x1006b9812040002 2023-02-19 08:00:20,986 DEBUG [RS:1;jenkins-hbase4:43395] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:20,986 DEBUG [RS:1;jenkins-hbase4:43395] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:20,986 DEBUG [RS:1;jenkins-hbase4:43395] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43395,1676793620692' 2023-02-19 08:00:20,986 DEBUG [RS:1;jenkins-hbase4:43395] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:20,987 DEBUG [RS:1;jenkins-hbase4:43395] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:20,987 DEBUG [RS:1;jenkins-hbase4:43395] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:20,987 DEBUG [RS:1;jenkins-hbase4:43395] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:20,987 DEBUG [RS:1;jenkins-hbase4:43395] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:20,987 DEBUG [RS:1;jenkins-hbase4:43395] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43395,1676793620692' 2023-02-19 08:00:20,987 DEBUG [RS:1;jenkins-hbase4:43395] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:20,988 DEBUG [RS:1;jenkins-hbase4:43395] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:20,988 DEBUG [RS:1;jenkins-hbase4:43395] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:20,988 INFO [RS:0;jenkins-hbase4:34367] regionserver.Replication(203): jenkins-hbase4.apache.org,34367,1676793620656 started 2023-02-19 08:00:20,988 INFO [RS:1;jenkins-hbase4:43395] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:20,988 INFO [RS:1;jenkins-hbase4:43395] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:20,988 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34367,1676793620656, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34367, sessionid=0x1006b9812040001 2023-02-19 08:00:20,988 DEBUG [RS:0;jenkins-hbase4:34367] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:20,988 DEBUG [RS:0;jenkins-hbase4:34367] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:20,988 DEBUG [RS:0;jenkins-hbase4:34367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34367,1676793620656' 2023-02-19 08:00:20,988 DEBUG [RS:0;jenkins-hbase4:34367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:20,989 DEBUG [RS:0;jenkins-hbase4:34367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:20,989 DEBUG [RS:0;jenkins-hbase4:34367] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:20,989 DEBUG [RS:0;jenkins-hbase4:34367] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:20,989 DEBUG [RS:0;jenkins-hbase4:34367] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:20,989 DEBUG [RS:0;jenkins-hbase4:34367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34367,1676793620656' 2023-02-19 08:00:20,989 DEBUG [RS:0;jenkins-hbase4:34367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:20,989 DEBUG [RS:0;jenkins-hbase4:34367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:20,990 DEBUG [RS:0;jenkins-hbase4:34367] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:20,990 INFO [RS:0;jenkins-hbase4:34367] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:20,990 INFO [RS:0;jenkins-hbase4:34367] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:21,070 DEBUG [jenkins-hbase4:40875] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 08:00:21,071 DEBUG [jenkins-hbase4:40875] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:21,072 DEBUG [jenkins-hbase4:40875] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:21,073 DEBUG [jenkins-hbase4:40875] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:21,073 DEBUG [jenkins-hbase4:40875] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:21,073 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43395,1676793620692, state=OPENING 2023-02-19 08:00:21,076 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 08:00:21,077 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:21,078 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:21,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43395,1676793620692}] 2023-02-19 08:00:21,232 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:21,233 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:21,235 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49152, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:21,239 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 08:00:21,239 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:21,241 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43395%2C1676793620692.meta, suffix=.meta, logDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/WALs/jenkins-hbase4.apache.org,43395,1676793620692, archiveDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/oldWALs, maxLogs=32 2023-02-19 08:00:21,258 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35097,DS-f1800b05-7d3c-4a26-a821-52a1a26ce4fb,DISK] 2023-02-19 08:00:21,258 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35313,DS-d5e2e394-d5b7-4d16-aafa-ba88ece19815,DISK] 2023-02-19 08:00:21,260 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/WALs/jenkins-hbase4.apache.org,43395,1676793620692/jenkins-hbase4.apache.org%2C43395%2C1676793620692.meta.1676793621242.meta 2023-02-19 08:00:21,260 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35097,DS-f1800b05-7d3c-4a26-a821-52a1a26ce4fb,DISK], DatanodeInfoWithStorage[127.0.0.1:35313,DS-d5e2e394-d5b7-4d16-aafa-ba88ece19815,DISK]] 2023-02-19 08:00:21,260 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:21,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 08:00:21,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 08:00:21,261 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 08:00:21,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 08:00:21,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:21,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 08:00:21,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 08:00:21,263 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:21,264 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/info 2023-02-19 08:00:21,264 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/info 2023-02-19 08:00:21,264 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:21,265 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:21,265 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:21,266 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:21,266 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:21,267 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:21,267 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:21,267 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:21,269 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/table 2023-02-19 08:00:21,269 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/table 2023-02-19 08:00:21,269 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:21,270 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:21,270 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740 2023-02-19 08:00:21,272 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740 2023-02-19 08:00:21,274 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:21,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:21,276 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60087148, jitterRate=-0.10463172197341919}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:21,276 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:21,277 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676793621232 2023-02-19 08:00:21,281 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 08:00:21,281 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 08:00:21,282 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43395,1676793620692, state=OPEN 2023-02-19 08:00:21,283 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 08:00:21,283 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:21,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 08:00:21,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43395,1676793620692 in 205 msec 2023-02-19 08:00:21,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 08:00:21,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 369 msec 2023-02-19 08:00:21,289 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 422 msec 2023-02-19 08:00:21,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676793621289, completionTime=-1 2023-02-19 08:00:21,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 08:00:21,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 08:00:21,292 DEBUG [hconnection-0x586dd978-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:21,293 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49158, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:21,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 08:00:21,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676793681295 2023-02-19 08:00:21,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676793741295 2023-02-19 08:00:21,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-19 08:00:21,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40875,1676793620588-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:21,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40875,1676793620588-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:21,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40875,1676793620588-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:21,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40875, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:21,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:21,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 08:00:21,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:21,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 08:00:21,305 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 08:00:21,305 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:21,306 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:21,308 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:21,308 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760 empty. 2023-02-19 08:00:21,309 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:21,309 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 08:00:21,318 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:21,319 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => dbdf78474e7760de7dc5cce2d490d760, NAME => 'hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:21,329 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:21,329 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing dbdf78474e7760de7dc5cce2d490d760, disabling compactions & flushes 2023-02-19 08:00:21,329 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:21,329 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:21,329 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. after waiting 0 ms 2023-02-19 08:00:21,329 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:21,329 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:21,329 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for dbdf78474e7760de7dc5cce2d490d760: 2023-02-19 08:00:21,332 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:21,333 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793621333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793621333"}]},"ts":"1676793621333"} 2023-02-19 08:00:21,336 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:21,337 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:21,337 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793621337"}]},"ts":"1676793621337"} 2023-02-19 08:00:21,339 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 08:00:21,343 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:21,343 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:21,343 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:21,344 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:21,344 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dbdf78474e7760de7dc5cce2d490d760, ASSIGN}] 2023-02-19 08:00:21,346 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dbdf78474e7760de7dc5cce2d490d760, ASSIGN 2023-02-19 08:00:21,347 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=dbdf78474e7760de7dc5cce2d490d760, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34367,1676793620656; forceNewPlan=false, retain=false 2023-02-19 08:00:21,497 INFO [jenkins-hbase4:40875] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:21,498 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dbdf78474e7760de7dc5cce2d490d760, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:21,498 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793621498"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793621498"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793621498"}]},"ts":"1676793621498"} 2023-02-19 08:00:21,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure dbdf78474e7760de7dc5cce2d490d760, server=jenkins-hbase4.apache.org,34367,1676793620656}] 2023-02-19 08:00:21,654 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:21,654 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:21,657 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37122, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:21,662 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:21,663 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34367%2C1676793620656, suffix=, logDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/WALs/jenkins-hbase4.apache.org,34367,1676793620656, archiveDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/oldWALs, maxLogs=32 2023-02-19 08:00:21,685 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35313,DS-d5e2e394-d5b7-4d16-aafa-ba88ece19815,DISK] 2023-02-19 08:00:21,687 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35097,DS-f1800b05-7d3c-4a26-a821-52a1a26ce4fb,DISK] 2023-02-19 08:00:21,689 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/WALs/jenkins-hbase4.apache.org,34367,1676793620656/jenkins-hbase4.apache.org%2C34367%2C1676793620656.1676793621664 2023-02-19 08:00:21,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35313,DS-d5e2e394-d5b7-4d16-aafa-ba88ece19815,DISK], DatanodeInfoWithStorage[127.0.0.1:35097,DS-f1800b05-7d3c-4a26-a821-52a1a26ce4fb,DISK]] 2023-02-19 08:00:21,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dbdf78474e7760de7dc5cce2d490d760, NAME => 'hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:21,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:21,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:21,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:21,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:21,691 INFO [StoreOpener-dbdf78474e7760de7dc5cce2d490d760-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:21,692 DEBUG [StoreOpener-dbdf78474e7760de7dc5cce2d490d760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760/info 2023-02-19 08:00:21,692 DEBUG [StoreOpener-dbdf78474e7760de7dc5cce2d490d760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760/info 2023-02-19 08:00:21,693 INFO [StoreOpener-dbdf78474e7760de7dc5cce2d490d760-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbdf78474e7760de7dc5cce2d490d760 columnFamilyName info 2023-02-19 08:00:21,693 INFO [StoreOpener-dbdf78474e7760de7dc5cce2d490d760-1] regionserver.HStore(310): Store=dbdf78474e7760de7dc5cce2d490d760/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:21,694 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:21,694 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:21,697 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:21,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:21,700 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dbdf78474e7760de7dc5cce2d490d760; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59357940, jitterRate=-0.11549776792526245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:21,700 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dbdf78474e7760de7dc5cce2d490d760: 2023-02-19 08:00:21,701 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760., pid=6, masterSystemTime=1676793621654 2023-02-19 08:00:21,705 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:21,705 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:21,706 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dbdf78474e7760de7dc5cce2d490d760, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:21,706 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793621705"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793621705"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793621705"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793621705"}]},"ts":"1676793621705"} 2023-02-19 08:00:21,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 08:00:21,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure dbdf78474e7760de7dc5cce2d490d760, server=jenkins-hbase4.apache.org,34367,1676793620656 in 206 msec 2023-02-19 08:00:21,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 08:00:21,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=dbdf78474e7760de7dc5cce2d490d760, ASSIGN in 365 msec 2023-02-19 08:00:21,712 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:21,713 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793621712"}]},"ts":"1676793621712"} 2023-02-19 08:00:21,714 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 08:00:21,717 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:21,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 414 msec 2023-02-19 08:00:21,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 08:00:21,809 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:21,809 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:21,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:21,816 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:21,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 08:00:21,834 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:21,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 21 msec 2023-02-19 08:00:21,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 08:00:21,858 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:21,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-19 08:00:21,885 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 08:00:21,887 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 08:00:21,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.167sec 2023-02-19 08:00:21,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 08:00:21,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 08:00:21,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 08:00:21,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40875,1676793620588-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 08:00:21,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40875,1676793620588-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 08:00:21,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 08:00:21,912 DEBUG [Listener at localhost/39595] zookeeper.ReadOnlyZKClient(139): Connect 0x20b1e1c6 to 127.0.0.1:57467 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:21,938 DEBUG [Listener at localhost/39595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ff72053, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:21,941 DEBUG [hconnection-0x2a32035f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:21,944 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:21,945 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40875,1676793620588 2023-02-19 08:00:21,945 DEBUG [Listener at localhost/39595] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 08:00:21,948 DEBUG [Listener at localhost/39595] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 08:00:21,950 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47152, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 08:00:21,950 INFO [Listener at localhost/39595] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 08:00:21,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 08:00:21,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 08:00:21,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:47152 deadline: 1676793681951, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-19 08:00:21,952 INFO [Listener at localhost/39595] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-19 08:00:21,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:21,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-19 08:00:21,957 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:21,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-19 08:00:21,958 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:21,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:21,966 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:21,966 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:21,966 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:21,966 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:21,966 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:21,966 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:21,966 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:21,966 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:21,967 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b empty. 2023-02-19 08:00:21,967 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8 empty. 2023-02-19 08:00:21,967 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555 empty. 2023-02-19 08:00:21,967 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9 empty. 2023-02-19 08:00:21,967 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2 empty. 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8 empty. 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2 empty. 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b empty. 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe empty. 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:21,969 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047 empty. 2023-02-19 08:00:21,969 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:21,969 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:21,968 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:21,969 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:21,969 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:21,969 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:21,969 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 08:00:21,980 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:21,981 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2aad437ae6a0fad0ff336a7f10638fb8, NAME => 'testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:21,982 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a1dac72385b876179012ba21ed7a817b, NAME => 'testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:21,982 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => dc0dcd299cf5eb6dbd5865dff9c884f2, NAME => 'testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:21,990 INFO [RS:1;jenkins-hbase4:43395] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43395%2C1676793620692, suffix=, logDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/WALs/jenkins-hbase4.apache.org,43395,1676793620692, archiveDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/oldWALs, maxLogs=32 2023-02-19 08:00:22,006 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,006 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,006 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a1dac72385b876179012ba21ed7a817b, disabling compactions & flushes 2023-02-19 08:00:22,006 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 2aad437ae6a0fad0ff336a7f10638fb8, disabling compactions & flushes 2023-02-19 08:00:22,006 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:22,006 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:22,006 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:22,006 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:22,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. after waiting 0 ms 2023-02-19 08:00:22,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:22,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. after waiting 0 ms 2023-02-19 08:00:22,007 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:22,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 2aad437ae6a0fad0ff336a7f10638fb8: 2023-02-19 08:00:22,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:22,007 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:22,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a1dac72385b876179012ba21ed7a817b: 2023-02-19 08:00:22,008 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 85945aa15e48fc7ac5462645b71681b2, NAME => 'testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:22,008 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6cc05be996fe008417d9c42176fe58a9, NAME => 'testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:22,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing dc0dcd299cf5eb6dbd5865dff9c884f2, disabling compactions & flushes 2023-02-19 08:00:22,008 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:22,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:22,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. after waiting 0 ms 2023-02-19 08:00:22,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:22,008 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:22,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for dc0dcd299cf5eb6dbd5865dff9c884f2: 2023-02-19 08:00:22,010 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 504d387527886fb86472f3fb84f7fdfe, NAME => 'testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:22,010 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35097,DS-f1800b05-7d3c-4a26-a821-52a1a26ce4fb,DISK] 2023-02-19 08:00:22,013 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35313,DS-d5e2e394-d5b7-4d16-aafa-ba88ece19815,DISK] 2023-02-19 08:00:22,015 INFO [RS:1;jenkins-hbase4:43395] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/WALs/jenkins-hbase4.apache.org,43395,1676793620692/jenkins-hbase4.apache.org%2C43395%2C1676793620692.1676793621991 2023-02-19 08:00:22,020 DEBUG [RS:1;jenkins-hbase4:43395] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35097,DS-f1800b05-7d3c-4a26-a821-52a1a26ce4fb,DISK], DatanodeInfoWithStorage[127.0.0.1:35313,DS-d5e2e394-d5b7-4d16-aafa-ba88ece19815,DISK]] 2023-02-19 08:00:22,033 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,033 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 504d387527886fb86472f3fb84f7fdfe, disabling compactions & flushes 2023-02-19 08:00:22,033 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:22,033 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:22,033 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. after waiting 0 ms 2023-02-19 08:00:22,033 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:22,033 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:22,033 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 504d387527886fb86472f3fb84f7fdfe: 2023-02-19 08:00:22,034 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c8342862229610c0a5f8524ae4b36555, NAME => 'testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:22,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 6cc05be996fe008417d9c42176fe58a9, disabling compactions & flushes 2023-02-19 08:00:22,034 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:22,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:22,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. after waiting 0 ms 2023-02-19 08:00:22,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:22,034 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:22,034 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 6cc05be996fe008417d9c42176fe58a9: 2023-02-19 08:00:22,035 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 27e7738ad5c485b9b7e82b69732bc6c8, NAME => 'testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:22,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c8342862229610c0a5f8524ae4b36555, disabling compactions & flushes 2023-02-19 08:00:22,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:22,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:22,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. after waiting 0 ms 2023-02-19 08:00:22,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:22,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:22,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 27e7738ad5c485b9b7e82b69732bc6c8, disabling compactions & flushes 2023-02-19 08:00:22,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c8342862229610c0a5f8524ae4b36555: 2023-02-19 08:00:22,047 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:22,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:22,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. after waiting 0 ms 2023-02-19 08:00:22,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:22,047 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => b7a69747770c2c175c780f40ecb3863b, NAME => 'testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:22,047 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:22,047 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 27e7738ad5c485b9b7e82b69732bc6c8: 2023-02-19 08:00:22,048 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d21b708922c39bf74a1d1893b6dbd047, NAME => 'testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.tmp 2023-02-19 08:00:22,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d21b708922c39bf74a1d1893b6dbd047, disabling compactions & flushes 2023-02-19 08:00:22,058 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:22,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:22,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. after waiting 0 ms 2023-02-19 08:00:22,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:22,059 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:22,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d21b708922c39bf74a1d1893b6dbd047: 2023-02-19 08:00:22,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing b7a69747770c2c175c780f40ecb3863b, disabling compactions & flushes 2023-02-19 08:00:22,059 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:22,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:22,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. after waiting 0 ms 2023-02-19 08:00:22,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:22,059 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:22,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for b7a69747770c2c175c780f40ecb3863b: 2023-02-19 08:00:22,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:22,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:22,430 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,430 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 85945aa15e48fc7ac5462645b71681b2, disabling compactions & flushes 2023-02-19 08:00:22,430 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:22,430 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:22,430 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. after waiting 0 ms 2023-02-19 08:00:22,430 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:22,430 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:22,430 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 85945aa15e48fc7ac5462645b71681b2: 2023-02-19 08:00:22,433 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:22,435 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793622434"}]},"ts":"1676793622434"} 2023-02-19 08:00:22,435 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793622434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793622434"}]},"ts":"1676793622434"} 2023-02-19 08:00:22,435 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793622434"}]},"ts":"1676793622434"} 2023-02-19 08:00:22,435 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793622434"}]},"ts":"1676793622434"} 2023-02-19 08:00:22,435 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793622434"}]},"ts":"1676793622434"} 2023-02-19 08:00:22,435 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793622434"}]},"ts":"1676793622434"} 2023-02-19 08:00:22,435 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793622434"}]},"ts":"1676793622434"} 2023-02-19 08:00:22,435 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793622434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793622434"}]},"ts":"1676793622434"} 2023-02-19 08:00:22,436 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793622434"}]},"ts":"1676793622434"} 2023-02-19 08:00:22,436 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793622434"}]},"ts":"1676793622434"} 2023-02-19 08:00:22,439 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-19 08:00:22,440 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:22,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793622440"}]},"ts":"1676793622440"} 2023-02-19 08:00:22,442 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-19 08:00:22,445 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:22,454 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:22,454 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:22,454 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:22,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a1dac72385b876179012ba21ed7a817b, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dc0dcd299cf5eb6dbd5865dff9c884f2, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2aad437ae6a0fad0ff336a7f10638fb8, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=85945aa15e48fc7ac5462645b71681b2, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6cc05be996fe008417d9c42176fe58a9, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=504d387527886fb86472f3fb84f7fdfe, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c8342862229610c0a5f8524ae4b36555, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=27e7738ad5c485b9b7e82b69732bc6c8, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b7a69747770c2c175c780f40ecb3863b, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d21b708922c39bf74a1d1893b6dbd047, ASSIGN}] 2023-02-19 08:00:22,457 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dc0dcd299cf5eb6dbd5865dff9c884f2, ASSIGN 2023-02-19 08:00:22,457 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a1dac72385b876179012ba21ed7a817b, ASSIGN 2023-02-19 08:00:22,458 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2aad437ae6a0fad0ff336a7f10638fb8, ASSIGN 2023-02-19 08:00:22,458 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=85945aa15e48fc7ac5462645b71681b2, ASSIGN 2023-02-19 08:00:22,459 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a1dac72385b876179012ba21ed7a817b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34367,1676793620656; forceNewPlan=false, retain=false 2023-02-19 08:00:22,459 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2aad437ae6a0fad0ff336a7f10638fb8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43395,1676793620692; forceNewPlan=false, retain=false 2023-02-19 08:00:22,459 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dc0dcd299cf5eb6dbd5865dff9c884f2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43395,1676793620692; forceNewPlan=false, retain=false 2023-02-19 08:00:22,459 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=85945aa15e48fc7ac5462645b71681b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34367,1676793620656; forceNewPlan=false, retain=false 2023-02-19 08:00:22,459 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d21b708922c39bf74a1d1893b6dbd047, ASSIGN 2023-02-19 08:00:22,460 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b7a69747770c2c175c780f40ecb3863b, ASSIGN 2023-02-19 08:00:22,460 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d21b708922c39bf74a1d1893b6dbd047, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34367,1676793620656; forceNewPlan=false, retain=false 2023-02-19 08:00:22,460 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=27e7738ad5c485b9b7e82b69732bc6c8, ASSIGN 2023-02-19 08:00:22,460 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c8342862229610c0a5f8524ae4b36555, ASSIGN 2023-02-19 08:00:22,460 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=504d387527886fb86472f3fb84f7fdfe, ASSIGN 2023-02-19 08:00:22,461 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b7a69747770c2c175c780f40ecb3863b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43395,1676793620692; forceNewPlan=false, retain=false 2023-02-19 08:00:22,461 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=27e7738ad5c485b9b7e82b69732bc6c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43395,1676793620692; forceNewPlan=false, retain=false 2023-02-19 08:00:22,461 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=504d387527886fb86472f3fb84f7fdfe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34367,1676793620656; forceNewPlan=false, retain=false 2023-02-19 08:00:22,461 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6cc05be996fe008417d9c42176fe58a9, ASSIGN 2023-02-19 08:00:22,461 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c8342862229610c0a5f8524ae4b36555, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34367,1676793620656; forceNewPlan=false, retain=false 2023-02-19 08:00:22,462 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6cc05be996fe008417d9c42176fe58a9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43395,1676793620692; forceNewPlan=false, retain=false 2023-02-19 08:00:22,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:22,609 INFO [jenkins-hbase4:40875] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-19 08:00:22,612 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=27e7738ad5c485b9b7e82b69732bc6c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:22,612 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2aad437ae6a0fad0ff336a7f10638fb8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:22,612 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b7a69747770c2c175c780f40ecb3863b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:22,612 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=dc0dcd299cf5eb6dbd5865dff9c884f2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:22,613 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793622612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793622612"}]},"ts":"1676793622612"} 2023-02-19 08:00:22,612 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6cc05be996fe008417d9c42176fe58a9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:22,613 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793622612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793622612"}]},"ts":"1676793622612"} 2023-02-19 08:00:22,613 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793622612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793622612"}]},"ts":"1676793622612"} 2023-02-19 08:00:22,613 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793622612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793622612"}]},"ts":"1676793622612"} 2023-02-19 08:00:22,613 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793622612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793622612"}]},"ts":"1676793622612"} 2023-02-19 08:00:22,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure b7a69747770c2c175c780f40ecb3863b, server=jenkins-hbase4.apache.org,43395,1676793620692}] 2023-02-19 08:00:22,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure dc0dcd299cf5eb6dbd5865dff9c884f2, server=jenkins-hbase4.apache.org,43395,1676793620692}] 2023-02-19 08:00:22,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure 2aad437ae6a0fad0ff336a7f10638fb8, server=jenkins-hbase4.apache.org,43395,1676793620692}] 2023-02-19 08:00:22,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=15, state=RUNNABLE; OpenRegionProcedure 6cc05be996fe008417d9c42176fe58a9, server=jenkins-hbase4.apache.org,43395,1676793620692}] 2023-02-19 08:00:22,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=18, state=RUNNABLE; OpenRegionProcedure 27e7738ad5c485b9b7e82b69732bc6c8, server=jenkins-hbase4.apache.org,43395,1676793620692}] 2023-02-19 08:00:22,621 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=d21b708922c39bf74a1d1893b6dbd047, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:22,621 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793622621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793622621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793622621"}]},"ts":"1676793622621"} 2023-02-19 08:00:22,623 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c8342862229610c0a5f8524ae4b36555, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:22,623 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622623"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793622623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793622623"}]},"ts":"1676793622623"} 2023-02-19 08:00:22,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure d21b708922c39bf74a1d1893b6dbd047, server=jenkins-hbase4.apache.org,34367,1676793620656}] 2023-02-19 08:00:22,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure c8342862229610c0a5f8524ae4b36555, server=jenkins-hbase4.apache.org,34367,1676793620656}] 2023-02-19 08:00:22,627 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=85945aa15e48fc7ac5462645b71681b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:22,627 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793622627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793622627"}]},"ts":"1676793622627"} 2023-02-19 08:00:22,627 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=a1dac72385b876179012ba21ed7a817b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:22,627 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=504d387527886fb86472f3fb84f7fdfe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:22,627 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793622627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793622627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793622627"}]},"ts":"1676793622627"} 2023-02-19 08:00:22,627 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793622627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793622627"}]},"ts":"1676793622627"} 2023-02-19 08:00:22,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=14, state=RUNNABLE; OpenRegionProcedure 85945aa15e48fc7ac5462645b71681b2, server=jenkins-hbase4.apache.org,34367,1676793620656}] 2023-02-19 08:00:22,631 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure a1dac72385b876179012ba21ed7a817b, server=jenkins-hbase4.apache.org,34367,1676793620656}] 2023-02-19 08:00:22,632 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure 504d387527886fb86472f3fb84f7fdfe, server=jenkins-hbase4.apache.org,34367,1676793620656}] 2023-02-19 08:00:22,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:22,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 27e7738ad5c485b9b7e82b69732bc6c8, NAME => 'testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-19 08:00:22,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:22,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:22,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:22,774 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:22,776 DEBUG [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f1 2023-02-19 08:00:22,776 DEBUG [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f1 2023-02-19 08:00:22,776 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27e7738ad5c485b9b7e82b69732bc6c8 columnFamilyName f1 2023-02-19 08:00:22,777 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] regionserver.HStore(310): Store=27e7738ad5c485b9b7e82b69732bc6c8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,777 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:22,778 DEBUG [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f2 2023-02-19 08:00:22,778 DEBUG [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f2 2023-02-19 08:00:22,779 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27e7738ad5c485b9b7e82b69732bc6c8 columnFamilyName f2 2023-02-19 08:00:22,779 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] regionserver.HStore(310): Store=27e7738ad5c485b9b7e82b69732bc6c8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:22,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:22,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:22,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 504d387527886fb86472f3fb84f7fdfe, NAME => 'testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-19 08:00:22,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:22,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:22,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:22,782 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:22,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:22,783 DEBUG [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f1 2023-02-19 08:00:22,783 DEBUG [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f1 2023-02-19 08:00:22,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:22,783 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 504d387527886fb86472f3fb84f7fdfe columnFamilyName f1 2023-02-19 08:00:22,786 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] regionserver.HStore(310): Store=504d387527886fb86472f3fb84f7fdfe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,786 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:22,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:22,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 27e7738ad5c485b9b7e82b69732bc6c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66486322, jitterRate=-0.009276598691940308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:22,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 27e7738ad5c485b9b7e82b69732bc6c8: 2023-02-19 08:00:22,787 DEBUG [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f2 2023-02-19 08:00:22,787 DEBUG [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f2 2023-02-19 08:00:22,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8., pid=25, masterSystemTime=1676793622768 2023-02-19 08:00:22,788 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 504d387527886fb86472f3fb84f7fdfe columnFamilyName f2 2023-02-19 08:00:22,788 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] regionserver.HStore(310): Store=504d387527886fb86472f3fb84f7fdfe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:22,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:22,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:22,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:22,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:22,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dc0dcd299cf5eb6dbd5865dff9c884f2, NAME => 'testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-19 08:00:22,790 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=27e7738ad5c485b9b7e82b69732bc6c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:22,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:22,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,790 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622790"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793622790"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793622790"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793622790"}]},"ts":"1676793622790"} 2023-02-19 08:00:22,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:22,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:22,791 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:22,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:22,793 DEBUG [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f1 2023-02-19 08:00:22,793 DEBUG [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f1 2023-02-19 08:00:22,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:22,793 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc0dcd299cf5eb6dbd5865dff9c884f2 columnFamilyName f1 2023-02-19 08:00:22,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=18 2023-02-19 08:00:22,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=18, state=SUCCESS; OpenRegionProcedure 27e7738ad5c485b9b7e82b69732bc6c8, server=jenkins-hbase4.apache.org,43395,1676793620692 in 172 msec 2023-02-19 08:00:22,794 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] regionserver.HStore(310): Store=dc0dcd299cf5eb6dbd5865dff9c884f2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,794 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:22,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=27e7738ad5c485b9b7e82b69732bc6c8, ASSIGN in 338 msec 2023-02-19 08:00:22,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:22,795 DEBUG [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f2 2023-02-19 08:00:22,795 DEBUG [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f2 2023-02-19 08:00:22,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 504d387527886fb86472f3fb84f7fdfe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72027227, jitterRate=0.07328931987285614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:22,795 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc0dcd299cf5eb6dbd5865dff9c884f2 columnFamilyName f2 2023-02-19 08:00:22,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 504d387527886fb86472f3fb84f7fdfe: 2023-02-19 08:00:22,796 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] regionserver.HStore(310): Store=dc0dcd299cf5eb6dbd5865dff9c884f2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe., pid=30, masterSystemTime=1676793622777 2023-02-19 08:00:22,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:22,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:22,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:22,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:22,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:22,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a1dac72385b876179012ba21ed7a817b, NAME => 'testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-19 08:00:22,798 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=504d387527886fb86472f3fb84f7fdfe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:22,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:22,798 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622798"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793622798"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793622798"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793622798"}]},"ts":"1676793622798"} 2023-02-19 08:00:22,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:22,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:22,799 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:22,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:22,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:22,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-19 08:00:22,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure 504d387527886fb86472f3fb84f7fdfe, server=jenkins-hbase4.apache.org,34367,1676793620656 in 168 msec 2023-02-19 08:00:22,802 DEBUG [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b/f1 2023-02-19 08:00:22,802 DEBUG [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b/f1 2023-02-19 08:00:22,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=504d387527886fb86472f3fb84f7fdfe, ASSIGN in 346 msec 2023-02-19 08:00:22,803 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1dac72385b876179012ba21ed7a817b columnFamilyName f1 2023-02-19 08:00:22,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:22,803 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] regionserver.HStore(310): Store=a1dac72385b876179012ba21ed7a817b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dc0dcd299cf5eb6dbd5865dff9c884f2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64804838, jitterRate=-0.03433266282081604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:22,803 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:22,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dc0dcd299cf5eb6dbd5865dff9c884f2: 2023-02-19 08:00:22,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2., pid=22, masterSystemTime=1676793622768 2023-02-19 08:00:22,805 DEBUG [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b/f2 2023-02-19 08:00:22,805 DEBUG [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b/f2 2023-02-19 08:00:22,805 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1dac72385b876179012ba21ed7a817b columnFamilyName f2 2023-02-19 08:00:22,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:22,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:22,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:22,806 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] regionserver.HStore(310): Store=a1dac72385b876179012ba21ed7a817b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b7a69747770c2c175c780f40ecb3863b, NAME => 'testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-19 08:00:22,806 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=dc0dcd299cf5eb6dbd5865dff9c884f2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:22,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:22,806 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622806"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793622806"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793622806"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793622806"}]},"ts":"1676793622806"} 2023-02-19 08:00:22,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:22,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:22,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:22,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:22,807 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:22,809 DEBUG [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f1 2023-02-19 08:00:22,809 DEBUG [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f1 2023-02-19 08:00:22,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:22,809 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-19 08:00:22,809 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7a69747770c2c175c780f40ecb3863b columnFamilyName f1 2023-02-19 08:00:22,809 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure dc0dcd299cf5eb6dbd5865dff9c884f2, server=jenkins-hbase4.apache.org,43395,1676793620692 in 191 msec 2023-02-19 08:00:22,810 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] regionserver.HStore(310): Store=b7a69747770c2c175c780f40ecb3863b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,810 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:22,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:22,811 DEBUG [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f2 2023-02-19 08:00:22,811 DEBUG [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f2 2023-02-19 08:00:22,811 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7a69747770c2c175c780f40ecb3863b columnFamilyName f2 2023-02-19 08:00:22,812 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] regionserver.HStore(310): Store=b7a69747770c2c175c780f40ecb3863b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,812 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dc0dcd299cf5eb6dbd5865dff9c884f2, ASSIGN in 355 msec 2023-02-19 08:00:22,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:22,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:22,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:22,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:22,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:22,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b7a69747770c2c175c780f40ecb3863b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68570666, jitterRate=0.02178254723548889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:22,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b7a69747770c2c175c780f40ecb3863b: 2023-02-19 08:00:22,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b., pid=21, masterSystemTime=1676793622768 2023-02-19 08:00:22,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:22,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:22,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:22,820 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b7a69747770c2c175c780f40ecb3863b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:22,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2aad437ae6a0fad0ff336a7f10638fb8, NAME => 'testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-19 08:00:22,820 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622820"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793622820"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793622820"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793622820"}]},"ts":"1676793622820"} 2023-02-19 08:00:22,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:22,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:22,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:22,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:22,822 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:22,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a1dac72385b876179012ba21ed7a817b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74600264, jitterRate=0.11163055896759033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:22,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a1dac72385b876179012ba21ed7a817b: 2023-02-19 08:00:22,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b., pid=29, masterSystemTime=1676793622777 2023-02-19 08:00:22,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-19 08:00:22,824 DEBUG [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f1 2023-02-19 08:00:22,824 DEBUG [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f1 2023-02-19 08:00:22,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure b7a69747770c2c175c780f40ecb3863b, server=jenkins-hbase4.apache.org,43395,1676793620692 in 207 msec 2023-02-19 08:00:22,824 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2aad437ae6a0fad0ff336a7f10638fb8 columnFamilyName f1 2023-02-19 08:00:22,825 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] regionserver.HStore(310): Store=2aad437ae6a0fad0ff336a7f10638fb8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,825 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:22,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b7a69747770c2c175c780f40ecb3863b, ASSIGN in 369 msec 2023-02-19 08:00:22,826 DEBUG [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f2 2023-02-19 08:00:22,826 DEBUG [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f2 2023-02-19 08:00:22,827 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2aad437ae6a0fad0ff336a7f10638fb8 columnFamilyName f2 2023-02-19 08:00:22,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:22,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:22,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:22,827 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=a1dac72385b876179012ba21ed7a817b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:22,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c8342862229610c0a5f8524ae4b36555, NAME => 'testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-19 08:00:22,827 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793622827"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793622827"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793622827"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793622827"}]},"ts":"1676793622827"} 2023-02-19 08:00:22,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:22,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:22,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:22,828 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] regionserver.HStore(310): Store=2aad437ae6a0fad0ff336a7f10638fb8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:22,829 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:22,830 DEBUG [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f1 2023-02-19 08:00:22,831 DEBUG [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f1 2023-02-19 08:00:22,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-19 08:00:22,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure a1dac72385b876179012ba21ed7a817b, server=jenkins-hbase4.apache.org,34367,1676793620656 in 198 msec 2023-02-19 08:00:22,831 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8342862229610c0a5f8524ae4b36555 columnFamilyName f1 2023-02-19 08:00:22,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:22,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a1dac72385b876179012ba21ed7a817b, ASSIGN in 377 msec 2023-02-19 08:00:22,833 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] regionserver.HStore(310): Store=c8342862229610c0a5f8524ae4b36555/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,833 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:22,834 DEBUG [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f2 2023-02-19 08:00:22,834 DEBUG [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f2 2023-02-19 08:00:22,834 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8342862229610c0a5f8524ae4b36555 columnFamilyName f2 2023-02-19 08:00:22,835 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] regionserver.HStore(310): Store=c8342862229610c0a5f8524ae4b36555/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:22,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:22,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:22,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:22,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:22,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:22,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:22,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2aad437ae6a0fad0ff336a7f10638fb8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69094342, jitterRate=0.029585927724838257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:22,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2aad437ae6a0fad0ff336a7f10638fb8: 2023-02-19 08:00:22,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8., pid=23, masterSystemTime=1676793622768 2023-02-19 08:00:22,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:22,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c8342862229610c0a5f8524ae4b36555; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65162686, jitterRate=-0.029000312089920044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:22,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c8342862229610c0a5f8524ae4b36555: 2023-02-19 08:00:22,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:22,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:22,844 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2aad437ae6a0fad0ff336a7f10638fb8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:22,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:22,844 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622844"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793622844"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793622844"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793622844"}]},"ts":"1676793622844"} 2023-02-19 08:00:22,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6cc05be996fe008417d9c42176fe58a9, NAME => 'testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-19 08:00:22,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:22,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:22,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:22,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555., pid=27, masterSystemTime=1676793622777 2023-02-19 08:00:22,847 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:22,848 DEBUG [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f1 2023-02-19 08:00:22,848 DEBUG [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f1 2023-02-19 08:00:22,848 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cc05be996fe008417d9c42176fe58a9 columnFamilyName f1 2023-02-19 08:00:22,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:22,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:22,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:22,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 85945aa15e48fc7ac5462645b71681b2, NAME => 'testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-19 08:00:22,849 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] regionserver.HStore(310): Store=6cc05be996fe008417d9c42176fe58a9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,849 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:22,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:22,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:22,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:22,850 DEBUG [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f2 2023-02-19 08:00:22,850 DEBUG [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f2 2023-02-19 08:00:22,851 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cc05be996fe008417d9c42176fe58a9 columnFamilyName f2 2023-02-19 08:00:22,851 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:22,851 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] regionserver.HStore(310): Store=6cc05be996fe008417d9c42176fe58a9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:22,852 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c8342862229610c0a5f8524ae4b36555, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:22,852 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793622852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793622852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793622852"}]},"ts":"1676793622852"} 2023-02-19 08:00:22,853 DEBUG [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f1 2023-02-19 08:00:22,853 DEBUG [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f1 2023-02-19 08:00:22,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:22,853 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85945aa15e48fc7ac5462645b71681b2 columnFamilyName f1 2023-02-19 08:00:22,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-19 08:00:22,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure 2aad437ae6a0fad0ff336a7f10638fb8, server=jenkins-hbase4.apache.org,43395,1676793620692 in 231 msec 2023-02-19 08:00:22,854 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] regionserver.HStore(310): Store=85945aa15e48fc7ac5462645b71681b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,854 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:22,856 DEBUG [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f2 2023-02-19 08:00:22,856 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2aad437ae6a0fad0ff336a7f10638fb8, ASSIGN in 399 msec 2023-02-19 08:00:22,856 DEBUG [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f2 2023-02-19 08:00:22,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:22,857 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85945aa15e48fc7ac5462645b71681b2 columnFamilyName f2 2023-02-19 08:00:22,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-19 08:00:22,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure c8342862229610c0a5f8524ae4b36555, server=jenkins-hbase4.apache.org,34367,1676793620656 in 228 msec 2023-02-19 08:00:22,857 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] regionserver.HStore(310): Store=85945aa15e48fc7ac5462645b71681b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:22,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:22,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:22,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c8342862229610c0a5f8524ae4b36555, ASSIGN in 402 msec 2023-02-19 08:00:22,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:22,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:22,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:22,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6cc05be996fe008417d9c42176fe58a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71510851, jitterRate=0.06559471786022186}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:22,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6cc05be996fe008417d9c42176fe58a9: 2023-02-19 08:00:22,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9., pid=24, masterSystemTime=1676793622768 2023-02-19 08:00:22,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:22,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 85945aa15e48fc7ac5462645b71681b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65793793, jitterRate=-0.01959608495235443}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:22,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 85945aa15e48fc7ac5462645b71681b2: 2023-02-19 08:00:22,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:22,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:22,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2., pid=28, masterSystemTime=1676793622777 2023-02-19 08:00:22,866 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6cc05be996fe008417d9c42176fe58a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:22,866 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622866"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793622866"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793622866"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793622866"}]},"ts":"1676793622866"} 2023-02-19 08:00:22,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:22,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:22,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:22,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d21b708922c39bf74a1d1893b6dbd047, NAME => 'testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-19 08:00:22,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:22,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:22,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:22,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:22,869 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=85945aa15e48fc7ac5462645b71681b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:22,869 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676793622869"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793622869"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793622869"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793622869"}]},"ts":"1676793622869"} 2023-02-19 08:00:22,870 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=15 2023-02-19 08:00:22,870 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=15, state=SUCCESS; OpenRegionProcedure 6cc05be996fe008417d9c42176fe58a9, server=jenkins-hbase4.apache.org,43395,1676793620692 in 250 msec 2023-02-19 08:00:22,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6cc05be996fe008417d9c42176fe58a9, ASSIGN in 415 msec 2023-02-19 08:00:22,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=14 2023-02-19 08:00:22,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=14, state=SUCCESS; OpenRegionProcedure 85945aa15e48fc7ac5462645b71681b2, server=jenkins-hbase4.apache.org,34367,1676793620656 in 241 msec 2023-02-19 08:00:22,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=85945aa15e48fc7ac5462645b71681b2, ASSIGN in 417 msec 2023-02-19 08:00:22,876 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:22,877 DEBUG [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047/f1 2023-02-19 08:00:22,877 DEBUG [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047/f1 2023-02-19 08:00:22,878 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d21b708922c39bf74a1d1893b6dbd047 columnFamilyName f1 2023-02-19 08:00:22,878 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] regionserver.HStore(310): Store=d21b708922c39bf74a1d1893b6dbd047/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,878 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:22,880 DEBUG [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047/f2 2023-02-19 08:00:22,880 DEBUG [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047/f2 2023-02-19 08:00:22,880 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d21b708922c39bf74a1d1893b6dbd047 columnFamilyName f2 2023-02-19 08:00:22,881 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] regionserver.HStore(310): Store=d21b708922c39bf74a1d1893b6dbd047/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:22,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:22,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:22,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:22,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:22,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:22,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d21b708922c39bf74a1d1893b6dbd047; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70287724, jitterRate=0.04736870527267456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:22,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d21b708922c39bf74a1d1893b6dbd047: 2023-02-19 08:00:22,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047., pid=26, masterSystemTime=1676793622777 2023-02-19 08:00:22,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:22,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:22,890 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=d21b708922c39bf74a1d1893b6dbd047, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:22,891 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676793622890"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793622890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793622890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793622890"}]},"ts":"1676793622890"} 2023-02-19 08:00:22,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-19 08:00:22,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure d21b708922c39bf74a1d1893b6dbd047, server=jenkins-hbase4.apache.org,34367,1676793620656 in 270 msec 2023-02-19 08:00:22,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-19 08:00:22,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d21b708922c39bf74a1d1893b6dbd047, ASSIGN in 440 msec 2023-02-19 08:00:22,899 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:22,899 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793622899"}]},"ts":"1676793622899"} 2023-02-19 08:00:22,901 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-19 08:00:22,903 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:22,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 949 msec 2023-02-19 08:00:23,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:23,066 INFO [Listener at localhost/39595] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-19 08:00:23,066 DEBUG [Listener at localhost/39595] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-19 08:00:23,066 INFO [Listener at localhost/39595] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:23,071 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-19 08:00:23,072 INFO [Listener at localhost/39595] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:23,072 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-19 08:00:23,072 INFO [Listener at localhost/39595] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 08:00:23,133 DEBUG [hconnection-0x2a32035f-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:23,146 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37134, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:23,156 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34367] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:23,167 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43395] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:23,267 INFO [Listener at localhost/39595] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 08:00:23,267 INFO [Listener at localhost/39595] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 08:00:23,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 08:00:23,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676793623269 (current time:1676793623269). 2023-02-19 08:00:23,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 08:00:23,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] zookeeper.ReadOnlyZKClient(139): Connect 0x09cb423d to 127.0.0.1:57467 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:23,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7462cc60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:23,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:23,281 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49164, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:23,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09cb423d to 127.0.0.1:57467 2023-02-19 08:00:23,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:23,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 08:00:23,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 08:00:23,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 08:00:23,287 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 08:00:23,288 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676794223287 2023-02-19 08:00:23,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 08:00:23,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-19 08:00:23,288 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:23,289 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 08:00:23,289 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 08:00:23,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 08:00:23,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-19 08:00:23,291 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 08:00:23,292 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676794223292 2023-02-19 08:00:23,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,319 INFO [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-19 08:00:23,319 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:23,320 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-19 08:00:23,320 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-19 08:00:23,320 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,320 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,322 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,322 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:23,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:23,322 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:23,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:23,323 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,323 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,323 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:23,323 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:23,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-19 08:00:23,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-19 08:00:23,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 08:00:23,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-19 08:00:23,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,325 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-19 08:00:23,325 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:23,328 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-19 08:00:23,329 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-19 08:00:23,329 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34367,1676793620656' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-19 08:00:23,329 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-19 08:00:23,329 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:23,329 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-19 08:00:23,329 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-19 08:00:23,329 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43395,1676793620692' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-19 08:00:23,331 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,331 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:23,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:23,331 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:23,331 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:23,331 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,332 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:23,332 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,332 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:23,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:23,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:23,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:23,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34367,1676793620656' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-19 08:00:23,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@685fec99[Count = 1] remaining members to acquire global barrier 2023-02-19 08:00:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:23,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:23,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:23,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43395,1676793620692' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-19 08:00:23,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@685fec99[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:23,337 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-19 08:00:23,337 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,338 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,338 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,338 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-19 08:00:23,338 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-19 08:00:23,338 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,339 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:23,339 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:23,340 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:23,340 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. started... 2023-02-19 08:00:23,345 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 85945aa15e48fc7ac5462645b71681b2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:23,348 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:23,348 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 08:00:23,348 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 08:00:23,348 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. started... 2023-02-19 08:00:23,348 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:23,348 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. started... 2023-02-19 08:00:23,348 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:23,348 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. started... 2023-02-19 08:00:23,357 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a1dac72385b876179012ba21ed7a817b: 2023-02-19 08:00:23,357 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:23,357 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6cc05be996fe008417d9c42176fe58a9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:23,357 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,357 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. started... 2023-02-19 08:00:23,357 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c8342862229610c0a5f8524ae4b36555 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:23,357 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:23,357 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:23,358 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:23,359 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 08:00:23,364 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 08:00:23,363 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:23,364 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. started... 2023-02-19 08:00:23,360 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 2aad437ae6a0fad0ff336a7f10638fb8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:23,369 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 27e7738ad5c485b9b7e82b69732bc6c8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:23,389 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:23,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:23,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:23,392 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 08:00:23,396 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. completed. 2023-02-19 08:00:23,396 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:23,397 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:23,397 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. started... 2023-02-19 08:00:23,397 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 08:00:23,399 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d21b708922c39bf74a1d1893b6dbd047: 2023-02-19 08:00:23,400 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,400 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:23,400 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:23,400 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:23,462 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/.tmp/f1/de9d8fb8bff74cecab74598f965c95cb 2023-02-19 08:00:23,489 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/.tmp/f1/27c24b552803407ab552e772c5c112a5 2023-02-19 08:00:23,509 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. completed. 2023-02-19 08:00:23,509 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:23,509 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:23,509 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 08:00:23,509 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/.tmp/f1/7702669ae37c4d27bc7a88d8f0824142 2023-02-19 08:00:23,509 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. started... 2023-02-19 08:00:23,512 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 504d387527886fb86472f3fb84f7fdfe 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:23,516 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/.tmp/f1/dd324e006edc450c9378dea34861db4e 2023-02-19 08:00:23,536 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/.tmp/f1/4694495f8e034d7db63c5e7c3818734b 2023-02-19 08:00:23,561 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/.tmp/f2/b1a3f2e311054e37863a24dcd5b1bb6c 2023-02-19 08:00:23,569 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/.tmp/f1/9397679832aa4841a3fea958c91f94b5 2023-02-19 08:00:23,570 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/.tmp/f2/a2972c510d3847498fe7ab1e46f56cac 2023-02-19 08:00:23,571 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/.tmp/f1/de9d8fb8bff74cecab74598f965c95cb as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f1/de9d8fb8bff74cecab74598f965c95cb 2023-02-19 08:00:23,579 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f1/de9d8fb8bff74cecab74598f965c95cb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:23,579 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/.tmp/f1/27c24b552803407ab552e772c5c112a5 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f1/27c24b552803407ab552e772c5c112a5 2023-02-19 08:00:23,580 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/.tmp/f2/b1a3f2e311054e37863a24dcd5b1bb6c as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f2/b1a3f2e311054e37863a24dcd5b1bb6c 2023-02-19 08:00:23,586 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f2/b1a3f2e311054e37863a24dcd5b1bb6c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:23,587 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 85945aa15e48fc7ac5462645b71681b2 in 243ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:23,587 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-19 08:00:23,587 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 85945aa15e48fc7ac5462645b71681b2: 2023-02-19 08:00:23,588 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,588 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:23,592 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f1/de9d8fb8bff74cecab74598f965c95cb] hfiles 2023-02-19 08:00:23,592 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f1/de9d8fb8bff74cecab74598f965c95cb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,592 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f2/b1a3f2e311054e37863a24dcd5b1bb6c] hfiles 2023-02-19 08:00:23,592 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f2/b1a3f2e311054e37863a24dcd5b1bb6c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,592 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/.tmp/f2/a019bf45794f456aacd4889651e28db7 2023-02-19 08:00:23,593 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:23,603 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f1/27c24b552803407ab552e772c5c112a5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:23,604 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 08:00:23,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:23,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:23,605 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-19 08:00:23,615 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/.tmp/f2/a2972c510d3847498fe7ab1e46f56cac as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f2/a2972c510d3847498fe7ab1e46f56cac 2023-02-19 08:00:23,621 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/.tmp/f1/7702669ae37c4d27bc7a88d8f0824142 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f1/7702669ae37c4d27bc7a88d8f0824142 2023-02-19 08:00:23,624 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f2/a2972c510d3847498fe7ab1e46f56cac, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:23,626 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6cc05be996fe008417d9c42176fe58a9 in 268ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:23,629 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6cc05be996fe008417d9c42176fe58a9: 2023-02-19 08:00:23,629 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,629 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:23,629 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f1/27c24b552803407ab552e772c5c112a5] hfiles 2023-02-19 08:00:23,629 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f1/27c24b552803407ab552e772c5c112a5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,629 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f2/a2972c510d3847498fe7ab1e46f56cac] hfiles 2023-02-19 08:00:23,629 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f2/a2972c510d3847498fe7ab1e46f56cac for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,630 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f1/7702669ae37c4d27bc7a88d8f0824142, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:23,630 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/.tmp/f2/a019bf45794f456aacd4889651e28db7 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f2/a019bf45794f456aacd4889651e28db7 2023-02-19 08:00:23,632 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/.tmp/f2/70ad886b800d4a55afd103aa375b149e 2023-02-19 08:00:23,650 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f2/a019bf45794f456aacd4889651e28db7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:23,651 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c8342862229610c0a5f8524ae4b36555 in 294ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:23,651 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c8342862229610c0a5f8524ae4b36555: 2023-02-19 08:00:23,651 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,651 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:23,651 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f1/7702669ae37c4d27bc7a88d8f0824142] hfiles 2023-02-19 08:00:23,651 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f1/7702669ae37c4d27bc7a88d8f0824142 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,651 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f2/a019bf45794f456aacd4889651e28db7] hfiles 2023-02-19 08:00:23,651 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f2/a019bf45794f456aacd4889651e28db7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,655 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/.tmp/f1/4694495f8e034d7db63c5e7c3818734b as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f1/4694495f8e034d7db63c5e7c3818734b 2023-02-19 08:00:23,668 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. completed. 2023-02-19 08:00:23,668 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:23,668 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 08:00:23,678 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f1/4694495f8e034d7db63c5e7c3818734b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:23,679 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/.tmp/f2/70ad886b800d4a55afd103aa375b149e as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f2/70ad886b800d4a55afd103aa375b149e 2023-02-19 08:00:23,698 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/.tmp/f2/6f94a02565894385824eedf8d8922f7d 2023-02-19 08:00:23,705 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f2/70ad886b800d4a55afd103aa375b149e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:23,705 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. completed. 2023-02-19 08:00:23,705 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:23,705 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:23,706 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. started... 2023-02-19 08:00:23,706 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegion(2744): Flushing dc0dcd299cf5eb6dbd5865dff9c884f2 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 08:00:23,706 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 08:00:23,707 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/.tmp/f1/9397679832aa4841a3fea958c91f94b5 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f1/9397679832aa4841a3fea958c91f94b5 2023-02-19 08:00:23,708 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2aad437ae6a0fad0ff336a7f10638fb8 in 348ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:23,708 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2aad437ae6a0fad0ff336a7f10638fb8: 2023-02-19 08:00:23,708 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,708 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:23,708 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f1/4694495f8e034d7db63c5e7c3818734b] hfiles 2023-02-19 08:00:23,708 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f1/4694495f8e034d7db63c5e7c3818734b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,708 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f2/70ad886b800d4a55afd103aa375b149e] hfiles 2023-02-19 08:00:23,709 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f2/70ad886b800d4a55afd103aa375b149e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,713 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. completed. 2023-02-19 08:00:23,713 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:23,713 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 08:00:23,726 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f1/9397679832aa4841a3fea958c91f94b5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:23,728 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/.tmp/f2/6f94a02565894385824eedf8d8922f7d as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f2/6f94a02565894385824eedf8d8922f7d 2023-02-19 08:00:23,741 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f2/6f94a02565894385824eedf8d8922f7d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:23,743 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 504d387527886fb86472f3fb84f7fdfe in 230ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:23,743 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 504d387527886fb86472f3fb84f7fdfe: 2023-02-19 08:00:23,743 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/.tmp/f1/3ea87af6c07449149a1d0df22c8d201a 2023-02-19 08:00:23,743 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,743 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:23,743 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f1/9397679832aa4841a3fea958c91f94b5] hfiles 2023-02-19 08:00:23,743 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f1/9397679832aa4841a3fea958c91f94b5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,743 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f2/6f94a02565894385824eedf8d8922f7d] hfiles 2023-02-19 08:00:23,743 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f2/6f94a02565894385824eedf8d8922f7d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,772 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. completed. 2023-02-19 08:00:23,773 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 08:00:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 08:00:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-19 08:00:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,34367,1676793620656' in zk 2023-02-19 08:00:23,775 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-19 08:00:23,775 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,775 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:23,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:23,775 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-19 08:00:23,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:23,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:23,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,778 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/.tmp/f2/e0a40379a1b140b2914609a0eaaf6c0b 2023-02-19 08:00:23,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:23,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:23,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:23,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,34367,1676793620656': 2023-02-19 08:00:23,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34367,1676793620656' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 08:00:23,784 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/.tmp/f1/3ea87af6c07449149a1d0df22c8d201a as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f1/3ea87af6c07449149a1d0df22c8d201a 2023-02-19 08:00:23,793 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f1/3ea87af6c07449149a1d0df22c8d201a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:23,794 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/.tmp/f2/e0a40379a1b140b2914609a0eaaf6c0b as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f2/e0a40379a1b140b2914609a0eaaf6c0b 2023-02-19 08:00:23,801 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f2/e0a40379a1b140b2914609a0eaaf6c0b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:23,802 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for dc0dcd299cf5eb6dbd5865dff9c884f2 in 96ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:23,802 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for dc0dcd299cf5eb6dbd5865dff9c884f2: 2023-02-19 08:00:23,802 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,802 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:23,802 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f1/3ea87af6c07449149a1d0df22c8d201a] hfiles 2023-02-19 08:00:23,802 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f1/3ea87af6c07449149a1d0df22c8d201a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,803 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f2/e0a40379a1b140b2914609a0eaaf6c0b] hfiles 2023-02-19 08:00:23,803 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f2/e0a40379a1b140b2914609a0eaaf6c0b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,812 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. completed. 2023-02-19 08:00:23,812 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:23,812 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:23,812 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 08:00:23,812 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. started... 2023-02-19 08:00:23,812 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b7a69747770c2c175c780f40ecb3863b 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 08:00:23,827 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/.tmp/f1/2ab09dc4f1854f6b8a6dab14f8754f07 2023-02-19 08:00:23,855 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/.tmp/f2/634bece06e854796a214ebc42f79fb2f 2023-02-19 08:00:23,861 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/.tmp/f1/2ab09dc4f1854f6b8a6dab14f8754f07 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f1/2ab09dc4f1854f6b8a6dab14f8754f07 2023-02-19 08:00:23,866 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f1/2ab09dc4f1854f6b8a6dab14f8754f07, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:23,867 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/.tmp/f2/634bece06e854796a214ebc42f79fb2f as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f2/634bece06e854796a214ebc42f79fb2f 2023-02-19 08:00:23,874 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f2/634bece06e854796a214ebc42f79fb2f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:23,875 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for b7a69747770c2c175c780f40ecb3863b in 63ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:23,875 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b7a69747770c2c175c780f40ecb3863b: 2023-02-19 08:00:23,876 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,876 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:23,876 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f1/2ab09dc4f1854f6b8a6dab14f8754f07] hfiles 2023-02-19 08:00:23,876 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f1/2ab09dc4f1854f6b8a6dab14f8754f07 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,876 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f2/634bece06e854796a214ebc42f79fb2f] hfiles 2023-02-19 08:00:23,876 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f2/634bece06e854796a214ebc42f79fb2f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:23,905 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:23,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:23,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:23,907 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-19 08:00:24,017 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/.tmp/f2/345b99abbd164f1394d19221f4d4f5ee 2023-02-19 08:00:24,023 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/.tmp/f1/dd324e006edc450c9378dea34861db4e as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f1/dd324e006edc450c9378dea34861db4e 2023-02-19 08:00:24,029 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f1/dd324e006edc450c9378dea34861db4e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:24,030 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/.tmp/f2/345b99abbd164f1394d19221f4d4f5ee as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f2/345b99abbd164f1394d19221f4d4f5ee 2023-02-19 08:00:24,035 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f2/345b99abbd164f1394d19221f4d4f5ee, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:24,035 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 27e7738ad5c485b9b7e82b69732bc6c8 in 666ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:24,036 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 27e7738ad5c485b9b7e82b69732bc6c8: 2023-02-19 08:00:24,036 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,036 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:24,036 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f1/dd324e006edc450c9378dea34861db4e] hfiles 2023-02-19 08:00:24,036 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f1/dd324e006edc450c9378dea34861db4e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,036 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f2/345b99abbd164f1394d19221f4d4f5ee] hfiles 2023-02-19 08:00:24,036 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f2/345b99abbd164f1394d19221f4d4f5ee for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,048 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. completed. 2023-02-19 08:00:24,048 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:24,048 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 08:00:24,137 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. completed. 2023-02-19 08:00:24,137 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:24,137 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 08:00:24,288 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. completed. 2023-02-19 08:00:24,288 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:24,288 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 08:00:24,288 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 08:00:24,288 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,288 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-19 08:00:24,288 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,43395,1676793620692' in zk 2023-02-19 08:00:24,290 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,290 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-19 08:00:24,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:24,290 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:24,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:24,290 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-19 08:00:24,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:24,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:24,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:24,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,43395,1676793620692': 2023-02-19 08:00:24,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43395,1676793620692' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 08:00:24,295 INFO [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-19 08:00:24,295 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:24,295 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:24,295 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,295 INFO [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 08:00:24,300 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,300 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,300 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,300 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:24,300 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:24,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:24,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:24,301 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,301 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:24,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:24,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,303 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:24,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:24,304 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:24,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,310 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,310 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:24,310 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:24,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:24,310 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:24,310 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:24,311 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:24,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,310 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:24,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,312 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,310 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:24,312 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:24,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:24,312 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,312 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:24,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:24,312 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,312 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,407 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:24,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:24,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:24,410 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-19 08:00:24,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-19 08:00:24,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,413 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:24,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676793623288Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676793624312 (+1024 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676793624312Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676793624335 (+23 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676793624348 (+13 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676793624413 (+65 ms) 2023-02-19 08:00:24,415 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 08:00:24,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1250 sec 2023-02-19 08:00:25,410 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:25,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:25,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 08:00:25,412 INFO [Listener at localhost/39595] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 08:00:25,420 INFO [Listener at localhost/39595] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 08:00:25,444 INFO [Listener at localhost/39595] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 08:00:25,485 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34367] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:25,500 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43395] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:25,837 INFO [Listener at localhost/39595] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 08:00:25,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 08:00:25,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-19 08:00:25,848 INFO [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-19 08:00:25,848 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:25,849 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-19 08:00:25,849 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-19 08:00:25,850 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:25,850 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:25,851 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:25,851 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:25,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:25,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:25,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:25,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:25,852 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:25,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:25,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:25,852 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:25,852 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:25,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:25,853 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:25,853 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:25,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:25,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:25,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:25,853 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 08:00:25,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:25,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:25,853 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 08:00:25,853 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 08:00:25,854 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 08:00:25,854 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:25,856 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 08:00:25,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 08:00:25,857 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:25,857 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. started... 2023-02-19 08:00:25,857 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 85945aa15e48fc7ac5462645b71681b2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:25,865 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 08:00:25,865 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:25,865 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:25,865 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 08:00:25,865 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 08:00:25,865 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. started... 2023-02-19 08:00:25,865 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 08:00:25,865 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:25,866 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c8342862229610c0a5f8524ae4b36555 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. started... 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a1dac72385b876179012ba21ed7a817b: 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:25,866 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. started... 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d21b708922c39bf74a1d1893b6dbd047: 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. started... 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. started... 2023-02-19 08:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:25,867 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2aad437ae6a0fad0ff336a7f10638fb8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:25,867 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 08:00:25,867 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 08:00:25,867 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6cc05be996fe008417d9c42176fe58a9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:25,867 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 08:00:25,867 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:25,867 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:25,868 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. started... 2023-02-19 08:00:25,868 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. started... 2023-02-19 08:00:25,868 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 504d387527886fb86472f3fb84f7fdfe 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:25,872 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 27e7738ad5c485b9b7e82b69732bc6c8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:25,944 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/.tmp/f1/81e4867e04f842e9af13e4f864bea06f 2023-02-19 08:00:25,949 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/.tmp/f1/1c18a610a479499f89842e8aaddc7b63 2023-02-19 08:00:25,954 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/.tmp/f1/22d64f1ba4894e61b5140f7c8fdd30f3 2023-02-19 08:00:25,963 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/.tmp/f1/8e6e858b0705495986d206852f0e6684 2023-02-19 08:00:25,976 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/.tmp/f1/28a9129226ea4ebd8f791cbcb2d64b94 2023-02-19 08:00:25,992 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/.tmp/f1/85ab7fc5b9344891bd414a1847790e86 2023-02-19 08:00:26,011 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/.tmp/f2/90a87c79c4804c4ebbd91076cc62f7b5 2023-02-19 08:00:26,024 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/.tmp/f2/685325c0f7b84d838d3d283ac9308ad6 2023-02-19 08:00:26,027 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/.tmp/f1/1c18a610a479499f89842e8aaddc7b63 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f1/1c18a610a479499f89842e8aaddc7b63 2023-02-19 08:00:26,034 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/.tmp/f1/81e4867e04f842e9af13e4f864bea06f as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f1/81e4867e04f842e9af13e4f864bea06f 2023-02-19 08:00:26,034 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/.tmp/f2/7c1e11a1a76446b9a762862c1c372466 2023-02-19 08:00:26,035 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f1/1c18a610a479499f89842e8aaddc7b63, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,036 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/.tmp/f2/90a87c79c4804c4ebbd91076cc62f7b5 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f2/90a87c79c4804c4ebbd91076cc62f7b5 2023-02-19 08:00:26,040 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f1/81e4867e04f842e9af13e4f864bea06f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,041 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/.tmp/f1/85ab7fc5b9344891bd414a1847790e86 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f1/85ab7fc5b9344891bd414a1847790e86 2023-02-19 08:00:26,042 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/.tmp/f2/685325c0f7b84d838d3d283ac9308ad6 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f2/685325c0f7b84d838d3d283ac9308ad6 2023-02-19 08:00:26,046 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f2/90a87c79c4804c4ebbd91076cc62f7b5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,048 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2aad437ae6a0fad0ff336a7f10638fb8 in 180ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:26,048 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2aad437ae6a0fad0ff336a7f10638fb8: 2023-02-19 08:00:26,048 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:26,048 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:26,048 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. started... 2023-02-19 08:00:26,048 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing dc0dcd299cf5eb6dbd5865dff9c884f2 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 08:00:26,049 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 08:00:26,053 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f1/85ab7fc5b9344891bd414a1847790e86, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,055 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/.tmp/f2/7c1e11a1a76446b9a762862c1c372466 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f2/7c1e11a1a76446b9a762862c1c372466 2023-02-19 08:00:26,056 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f2/685325c0f7b84d838d3d283ac9308ad6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,059 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c8342862229610c0a5f8524ae4b36555 in 193ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:26,059 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c8342862229610c0a5f8524ae4b36555: 2023-02-19 08:00:26,059 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:26,059 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 08:00:26,069 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f2/7c1e11a1a76446b9a762862c1c372466, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,070 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 504d387527886fb86472f3fb84f7fdfe in 202ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:26,070 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 504d387527886fb86472f3fb84f7fdfe: 2023-02-19 08:00:26,070 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:26,070 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 08:00:26,076 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/.tmp/f1/0862ad1aa14d4df5b1827c8a9ff902a2 2023-02-19 08:00:26,098 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/.tmp/f2/c4c103d49ad14967ba67e3f115133fbe 2023-02-19 08:00:26,104 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/.tmp/f1/0862ad1aa14d4df5b1827c8a9ff902a2 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f1/0862ad1aa14d4df5b1827c8a9ff902a2 2023-02-19 08:00:26,111 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f1/0862ad1aa14d4df5b1827c8a9ff902a2, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:26,112 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/.tmp/f2/c4c103d49ad14967ba67e3f115133fbe as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f2/c4c103d49ad14967ba67e3f115133fbe 2023-02-19 08:00:26,118 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f2/c4c103d49ad14967ba67e3f115133fbe, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:26,119 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for dc0dcd299cf5eb6dbd5865dff9c884f2 in 71ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:26,119 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for dc0dcd299cf5eb6dbd5865dff9c884f2: 2023-02-19 08:00:26,119 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:26,119 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:26,119 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 08:00:26,119 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. started... 2023-02-19 08:00:26,119 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b7a69747770c2c175c780f40ecb3863b 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 08:00:26,135 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/.tmp/f1/df6dfa2274f04b7eb184510a55868455 2023-02-19 08:00:26,161 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/.tmp/f2/d755b49c6b9c4015b414720d5fd7f0af 2023-02-19 08:00:26,167 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/.tmp/f1/df6dfa2274f04b7eb184510a55868455 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f1/df6dfa2274f04b7eb184510a55868455 2023-02-19 08:00:26,172 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f1/df6dfa2274f04b7eb184510a55868455, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:26,173 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/.tmp/f2/d755b49c6b9c4015b414720d5fd7f0af as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f2/d755b49c6b9c4015b414720d5fd7f0af 2023-02-19 08:00:26,177 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f2/d755b49c6b9c4015b414720d5fd7f0af, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:26,178 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for b7a69747770c2c175c780f40ecb3863b in 59ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:26,178 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b7a69747770c2c175c780f40ecb3863b: 2023-02-19 08:00:26,178 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:26,179 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 08:00:26,427 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/.tmp/f2/6d46cb36511d4c26a937493cc741a614 2023-02-19 08:00:26,431 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/.tmp/f2/3384d6eb84c84013ad13ba4f903dc9ab 2023-02-19 08:00:26,433 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/.tmp/f1/22d64f1ba4894e61b5140f7c8fdd30f3 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f1/22d64f1ba4894e61b5140f7c8fdd30f3 2023-02-19 08:00:26,433 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/.tmp/f2/5864907651f84b1d9245d005dafc7022 2023-02-19 08:00:26,437 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/.tmp/f1/8e6e858b0705495986d206852f0e6684 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f1/8e6e858b0705495986d206852f0e6684 2023-02-19 08:00:26,438 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f1/22d64f1ba4894e61b5140f7c8fdd30f3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,439 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/.tmp/f2/6d46cb36511d4c26a937493cc741a614 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f2/6d46cb36511d4c26a937493cc741a614 2023-02-19 08:00:26,439 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/.tmp/f1/28a9129226ea4ebd8f791cbcb2d64b94 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f1/28a9129226ea4ebd8f791cbcb2d64b94 2023-02-19 08:00:26,442 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f1/8e6e858b0705495986d206852f0e6684, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,443 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/.tmp/f2/3384d6eb84c84013ad13ba4f903dc9ab as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f2/3384d6eb84c84013ad13ba4f903dc9ab 2023-02-19 08:00:26,445 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f1/28a9129226ea4ebd8f791cbcb2d64b94, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,446 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/.tmp/f2/5864907651f84b1d9245d005dafc7022 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f2/5864907651f84b1d9245d005dafc7022 2023-02-19 08:00:26,450 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f2/6d46cb36511d4c26a937493cc741a614, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,450 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f2/3384d6eb84c84013ad13ba4f903dc9ab, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,451 INFO [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 85945aa15e48fc7ac5462645b71681b2 in 594ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:26,451 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6cc05be996fe008417d9c42176fe58a9 in 584ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:26,451 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 85945aa15e48fc7ac5462645b71681b2: 2023-02-19 08:00:26,451 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6cc05be996fe008417d9c42176fe58a9: 2023-02-19 08:00:26,451 DEBUG [rs(jenkins-hbase4.apache.org,34367,1676793620656)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:26,451 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 08:00:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 08:00:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 08:00:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 08:00:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34367,1676793620656' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 08:00:26,451 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f2/5864907651f84b1d9245d005dafc7022, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:26,452 INFO [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 27e7738ad5c485b9b7e82b69732bc6c8 in 580ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:26,452 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 27e7738ad5c485b9b7e82b69732bc6c8: 2023-02-19 08:00:26,452 DEBUG [rs(jenkins-hbase4.apache.org,43395,1676793620692)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:26,452 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 08:00:26,452 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 08:00:26,452 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,452 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 08:00:26,452 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43395,1676793620692' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 08:00:26,453 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,453 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:26,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:26,458 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:26,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34367,1676793620656' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 08:00:26,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c60754a[Count = 1] remaining members to acquire global barrier 2023-02-19 08:00:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:26,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:26,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:26,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43395,1676793620692' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 08:00:26,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c60754a[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:26,461 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-19 08:00:26,461 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,463 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,463 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,463 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 08:00:26,463 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 08:00:26,463 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 08:00:26,463 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,463 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34367,1676793620656' in zk 2023-02-19 08:00:26,463 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 08:00:26,463 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43395,1676793620692' in zk 2023-02-19 08:00:26,463 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,464 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:26,464 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 08:00:26,464 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,465 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:26,465 DEBUG [member: 'jenkins-hbase4.apache.org,34367,1676793620656' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 08:00:26,466 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 08:00:26,466 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,466 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:26,466 DEBUG [member: 'jenkins-hbase4.apache.org,43395,1676793620692' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 08:00:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,34367,1676793620656': 2023-02-19 08:00:26,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34367,1676793620656' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-19 08:00:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43395,1676793620692': 2023-02-19 08:00:26,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43395,1676793620692' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-19 08:00:26,472 INFO [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-19 08:00:26,472 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:26,472 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:26,472 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-19 08:00:26,472 INFO [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 08:00:26,475 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,475 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,475 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,475 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:26,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,475 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:26,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:26,475 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,476 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:26,478 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,478 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,481 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,481 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:26,482 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:26,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:26,482 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,482 DEBUG [(jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:26,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-19 08:00:26,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 08:00:26,482 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:26,483 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,483 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,483 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,483 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:26,483 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:26,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-19 08:00:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:26,482 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:26,483 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:26,483 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:26,483 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 08:00:26,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:26,484 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:26,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:26,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:26,584 DEBUG [Listener at localhost/39595] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 08:00:26,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40875] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 08:00:26,586 INFO [Listener at localhost/39595] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 08:00:26,586 DEBUG [Listener at localhost/39595] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20b1e1c6 to 127.0.0.1:57467 2023-02-19 08:00:26,586 DEBUG [Listener at localhost/39595] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:26,586 DEBUG [Listener at localhost/39595] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 08:00:26,587 DEBUG [Listener at localhost/39595] util.JVMClusterUtil(257): Found active master hash=86240742, stopped=false 2023-02-19 08:00:26,587 INFO [Listener at localhost/39595] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40875,1676793620588 2023-02-19 08:00:26,590 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:26,590 INFO [Listener at localhost/39595] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 08:00:26,590 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:26,590 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:26,591 DEBUG [Listener at localhost/39595] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x096b2500 to 127.0.0.1:57467 2023-02-19 08:00:26,591 DEBUG [Listener at localhost/39595] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:26,591 INFO [Listener at localhost/39595] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34367,1676793620656' ***** 2023-02-19 08:00:26,591 INFO [Listener at localhost/39595] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:26,591 INFO [Listener at localhost/39595] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43395,1676793620692' ***** 2023-02-19 08:00:26,591 INFO [Listener at localhost/39595] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:26,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:26,593 INFO [RS:1;jenkins-hbase4:43395] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:26,593 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:26,593 INFO [RS:1;jenkins-hbase4:43395] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:26,593 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:26,593 INFO [RS:1;jenkins-hbase4:43395] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:26,594 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(3304): Received CLOSE for 6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:26,592 INFO [RS:0;jenkins-hbase4:34367] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:26,595 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(3304): Received CLOSE for 2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:26,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:26,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6cc05be996fe008417d9c42176fe58a9, disabling compactions & flushes 2023-02-19 08:00:26,595 INFO [RS:0;jenkins-hbase4:34367] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:26,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:26,595 INFO [RS:0;jenkins-hbase4:34367] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:26,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:26,595 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(3304): Received CLOSE for 85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:26,595 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(3304): Received CLOSE for 27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:26,595 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(3304): Received CLOSE for dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:26,595 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(3304): Received CLOSE for b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:26,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:26,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. after waiting 0 ms 2023-02-19 08:00:26,595 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,595 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:26,596 DEBUG [RS:1;jenkins-hbase4:43395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x000ffd1a to 127.0.0.1:57467 2023-02-19 08:00:26,596 DEBUG [RS:1;jenkins-hbase4:43395] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:26,597 INFO [RS:1;jenkins-hbase4:43395] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:26,597 INFO [RS:1;jenkins-hbase4:43395] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:26,597 INFO [RS:1;jenkins-hbase4:43395] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:26,597 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 08:00:26,596 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(3304): Received CLOSE for dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:26,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:26,597 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(3304): Received CLOSE for c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:26,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 85945aa15e48fc7ac5462645b71681b2, disabling compactions & flushes 2023-02-19 08:00:26,597 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(3304): Received CLOSE for a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:26,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:26,597 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(3304): Received CLOSE for d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:26,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:26,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. after waiting 0 ms 2023-02-19 08:00:26,597 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(3304): Received CLOSE for 504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:26,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:26,598 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:26,598 DEBUG [RS:0;jenkins-hbase4:34367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13652343 to 127.0.0.1:57467 2023-02-19 08:00:26,598 DEBUG [RS:0;jenkins-hbase4:34367] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:26,598 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-19 08:00:26,598 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1479): Online Regions={85945aa15e48fc7ac5462645b71681b2=testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2., dbdf78474e7760de7dc5cce2d490d760=hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760., c8342862229610c0a5f8524ae4b36555=testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555., a1dac72385b876179012ba21ed7a817b=testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b., d21b708922c39bf74a1d1893b6dbd047=testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047., 504d387527886fb86472f3fb84f7fdfe=testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.} 2023-02-19 08:00:26,598 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1505): Waiting on 504d387527886fb86472f3fb84f7fdfe, 85945aa15e48fc7ac5462645b71681b2, a1dac72385b876179012ba21ed7a817b, c8342862229610c0a5f8524ae4b36555, d21b708922c39bf74a1d1893b6dbd047, dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:26,599 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-19 08:00:26,599 DEBUG [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1479): Online Regions={6cc05be996fe008417d9c42176fe58a9=testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9., 2aad437ae6a0fad0ff336a7f10638fb8=testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8., 27e7738ad5c485b9b7e82b69732bc6c8=testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8., dc0dcd299cf5eb6dbd5865dff9c884f2=testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2., 1588230740=hbase:meta,,1.1588230740, b7a69747770c2c175c780f40ecb3863b=testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.} 2023-02-19 08:00:26,599 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:26,599 DEBUG [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1505): Waiting on 1588230740, 27e7738ad5c485b9b7e82b69732bc6c8, 2aad437ae6a0fad0ff336a7f10638fb8, 6cc05be996fe008417d9c42176fe58a9, b7a69747770c2c175c780f40ecb3863b, dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:26,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:26,599 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:26,599 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:26,600 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:26,600 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-19 08:00:26,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:26,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:26,646 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:26,646 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:26,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:26,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 85945aa15e48fc7ac5462645b71681b2: 2023-02-19 08:00:26,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:26,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:26,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6cc05be996fe008417d9c42176fe58a9: 2023-02-19 08:00:26,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dbdf78474e7760de7dc5cce2d490d760, disabling compactions & flushes 2023-02-19 08:00:26,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:26,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:26,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2aad437ae6a0fad0ff336a7f10638fb8, disabling compactions & flushes 2023-02-19 08:00:26,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:26,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:26,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. after waiting 0 ms 2023-02-19 08:00:26,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:26,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:26,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing dbdf78474e7760de7dc5cce2d490d760 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 08:00:26,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. after waiting 0 ms 2023-02-19 08:00:26,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:26,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/.tmp/info/010e579361a7429e9025a6a7f5553063 2023-02-19 08:00:26,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:26,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:26,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2aad437ae6a0fad0ff336a7f10638fb8: 2023-02-19 08:00:26,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:26,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 27e7738ad5c485b9b7e82b69732bc6c8, disabling compactions & flushes 2023-02-19 08:00:26,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:26,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:26,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. after waiting 0 ms 2023-02-19 08:00:26,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:26,705 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/.tmp/table/5071bcb6cede4323879e46cc242da2d9 2023-02-19 08:00:26,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:26,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:26,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 27e7738ad5c485b9b7e82b69732bc6c8: 2023-02-19 08:00:26,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:26,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dc0dcd299cf5eb6dbd5865dff9c884f2, disabling compactions & flushes 2023-02-19 08:00:26,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:26,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:26,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. after waiting 0 ms 2023-02-19 08:00:26,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:26,712 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/.tmp/info/010e579361a7429e9025a6a7f5553063 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/info/010e579361a7429e9025a6a7f5553063 2023-02-19 08:00:26,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:26,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:26,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dc0dcd299cf5eb6dbd5865dff9c884f2: 2023-02-19 08:00:26,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:26,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b7a69747770c2c175c780f40ecb3863b, disabling compactions & flushes 2023-02-19 08:00:26,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:26,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:26,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. after waiting 0 ms 2023-02-19 08:00:26,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:26,718 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/info/010e579361a7429e9025a6a7f5553063, entries=110, sequenceid=32, filesize=18.7 K 2023-02-19 08:00:26,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:26,720 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/.tmp/table/5071bcb6cede4323879e46cc242da2d9 as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/table/5071bcb6cede4323879e46cc242da2d9 2023-02-19 08:00:26,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:26,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b7a69747770c2c175c780f40ecb3863b: 2023-02-19 08:00:26,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:26,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/table/5071bcb6cede4323879e46cc242da2d9, entries=4, sequenceid=32, filesize=4.8 K 2023-02-19 08:00:26,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 127ms, sequenceid=32, compaction requested=false 2023-02-19 08:00:26,727 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-19 08:00:26,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-19 08:00:26,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 08:00:26,733 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:26,733 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:26,733 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:26,798 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1505): Waiting on 504d387527886fb86472f3fb84f7fdfe, a1dac72385b876179012ba21ed7a817b, c8342862229610c0a5f8524ae4b36555, d21b708922c39bf74a1d1893b6dbd047, dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:26,799 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43395,1676793620692; all regions closed. 2023-02-19 08:00:26,805 DEBUG [RS:1;jenkins-hbase4:43395] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/oldWALs 2023-02-19 08:00:26,805 INFO [RS:1;jenkins-hbase4:43395] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43395%2C1676793620692.meta:.meta(num 1676793621242) 2023-02-19 08:00:26,808 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/WALs/jenkins-hbase4.apache.org,43395,1676793620692/jenkins-hbase4.apache.org%2C43395%2C1676793620692.1676793621991 not finished, retry = 0 2023-02-19 08:00:26,911 DEBUG [RS:1;jenkins-hbase4:43395] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/oldWALs 2023-02-19 08:00:26,911 INFO [RS:1;jenkins-hbase4:43395] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43395%2C1676793620692:(num 1676793621991) 2023-02-19 08:00:26,911 DEBUG [RS:1;jenkins-hbase4:43395] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:26,911 INFO [RS:1;jenkins-hbase4:43395] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:26,911 INFO [RS:1;jenkins-hbase4:43395] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:26,911 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:26,912 INFO [RS:1;jenkins-hbase4:43395] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43395 2023-02-19 08:00:26,915 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:26,915 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,915 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43395,1676793620692 2023-02-19 08:00:26,915 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:26,915 ERROR [Listener at localhost/39595-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30b82205 rejected from java.util.concurrent.ThreadPoolExecutor@3487b0ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:26,915 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:26,915 ERROR [Listener at localhost/39595-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31e79fbf rejected from java.util.concurrent.ThreadPoolExecutor@3487b0ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:26,916 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43395,1676793620692] 2023-02-19 08:00:26,916 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43395,1676793620692; numProcessing=1 2023-02-19 08:00:26,918 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43395,1676793620692 already deleted, retry=false 2023-02-19 08:00:26,918 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43395,1676793620692 expired; onlineServers=1 2023-02-19 08:00:26,958 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-19 08:00:26,966 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 08:00:26,966 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 08:00:26,999 DEBUG [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1505): Waiting on 504d387527886fb86472f3fb84f7fdfe, a1dac72385b876179012ba21ed7a817b, c8342862229610c0a5f8524ae4b36555, d21b708922c39bf74a1d1893b6dbd047, dbdf78474e7760de7dc5cce2d490d760 2023-02-19 08:00:27,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760/.tmp/info/f3e3b56f47dd4c37a29a4ce8d01b826e 2023-02-19 08:00:27,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760/.tmp/info/f3e3b56f47dd4c37a29a4ce8d01b826e as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760/info/f3e3b56f47dd4c37a29a4ce8d01b826e 2023-02-19 08:00:27,093 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:27,093 ERROR [Listener at localhost/39595-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@49b6d2a1 rejected from java.util.concurrent.ThreadPoolExecutor@3487b0ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:27,093 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:43395-0x1006b9812040002, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:27,093 ERROR [Listener at localhost/39595-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cbda89c rejected from java.util.concurrent.ThreadPoolExecutor@3487b0ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:27,094 INFO [RS:1;jenkins-hbase4:43395] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43395,1676793620692; zookeeper connection closed. 2023-02-19 08:00:27,096 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@561afded] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@561afded 2023-02-19 08:00:27,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760/info/f3e3b56f47dd4c37a29a4ce8d01b826e, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 08:00:27,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for dbdf78474e7760de7dc5cce2d490d760 in 452ms, sequenceid=6, compaction requested=false 2023-02-19 08:00:27,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/hbase/namespace/dbdf78474e7760de7dc5cce2d490d760/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 08:00:27,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:27,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dbdf78474e7760de7dc5cce2d490d760: 2023-02-19 08:00:27,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676793621303.dbdf78474e7760de7dc5cce2d490d760. 2023-02-19 08:00:27,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c8342862229610c0a5f8524ae4b36555, disabling compactions & flushes 2023-02-19 08:00:27,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:27,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:27,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. after waiting 0 ms 2023-02-19 08:00:27,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:27,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:27,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c8342862229610c0a5f8524ae4b36555: 2023-02-19 08:00:27,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:27,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a1dac72385b876179012ba21ed7a817b, disabling compactions & flushes 2023-02-19 08:00:27,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:27,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:27,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. after waiting 0 ms 2023-02-19 08:00:27,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:27,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 08:00:27,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:27,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a1dac72385b876179012ba21ed7a817b: 2023-02-19 08:00:27,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:27,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d21b708922c39bf74a1d1893b6dbd047, disabling compactions & flushes 2023-02-19 08:00:27,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:27,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:27,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. after waiting 0 ms 2023-02-19 08:00:27,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:27,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 08:00:27,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d21b708922c39bf74a1d1893b6dbd047: 2023-02-19 08:00:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 504d387527886fb86472f3fb84f7fdfe, disabling compactions & flushes 2023-02-19 08:00:27,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. after waiting 0 ms 2023-02-19 08:00:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:27,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:27,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:27,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 504d387527886fb86472f3fb84f7fdfe: 2023-02-19 08:00:27,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:27,199 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34367,1676793620656; all regions closed. 2023-02-19 08:00:27,205 DEBUG [RS:0;jenkins-hbase4:34367] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/oldWALs 2023-02-19 08:00:27,205 INFO [RS:0;jenkins-hbase4:34367] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34367%2C1676793620656:(num 1676793621664) 2023-02-19 08:00:27,205 DEBUG [RS:0;jenkins-hbase4:34367] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:27,205 INFO [RS:0;jenkins-hbase4:34367] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:27,205 INFO [RS:0;jenkins-hbase4:34367] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:27,205 INFO [RS:0;jenkins-hbase4:34367] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:27,205 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:27,205 INFO [RS:0;jenkins-hbase4:34367] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:27,205 INFO [RS:0;jenkins-hbase4:34367] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:27,206 INFO [RS:0;jenkins-hbase4:34367] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34367 2023-02-19 08:00:27,210 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:27,210 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34367,1676793620656 2023-02-19 08:00:27,210 ERROR [Listener at localhost/39595-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@d37cc3c rejected from java.util.concurrent.ThreadPoolExecutor@9085942[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:27,211 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34367,1676793620656] 2023-02-19 08:00:27,211 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34367,1676793620656; numProcessing=2 2023-02-19 08:00:27,213 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34367,1676793620656 already deleted, retry=false 2023-02-19 08:00:27,213 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34367,1676793620656 expired; onlineServers=0 2023-02-19 08:00:27,213 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40875,1676793620588' ***** 2023-02-19 08:00:27,213 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 08:00:27,214 DEBUG [M:0;jenkins-hbase4:40875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@441ee7dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:27,214 INFO [M:0;jenkins-hbase4:40875] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40875,1676793620588 2023-02-19 08:00:27,214 INFO [M:0;jenkins-hbase4:40875] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40875,1676793620588; all regions closed. 2023-02-19 08:00:27,214 DEBUG [M:0;jenkins-hbase4:40875] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:27,214 DEBUG [M:0;jenkins-hbase4:40875] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 08:00:27,214 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 08:00:27,214 DEBUG [M:0;jenkins-hbase4:40875] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 08:00:27,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793620875] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793620875,5,FailOnTimeoutGroup] 2023-02-19 08:00:27,215 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:27,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793620875] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793620875,5,FailOnTimeoutGroup] 2023-02-19 08:00:27,216 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:27,215 INFO [M:0;jenkins-hbase4:40875] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 08:00:27,216 INFO [M:0;jenkins-hbase4:40875] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 08:00:27,216 INFO [M:0;jenkins-hbase4:40875] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 08:00:27,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:27,216 DEBUG [M:0;jenkins-hbase4:40875] master.HMaster(1512): Stopping service threads 2023-02-19 08:00:27,217 INFO [M:0;jenkins-hbase4:40875] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 08:00:27,217 ERROR [M:0;jenkins-hbase4:40875] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 08:00:27,217 INFO [M:0;jenkins-hbase4:40875] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 08:00:27,217 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 08:00:27,218 DEBUG [M:0;jenkins-hbase4:40875] zookeeper.ZKUtil(398): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 08:00:27,218 WARN [M:0;jenkins-hbase4:40875] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 08:00:27,218 INFO [M:0;jenkins-hbase4:40875] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 08:00:27,219 INFO [M:0;jenkins-hbase4:40875] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 08:00:27,219 DEBUG [M:0;jenkins-hbase4:40875] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:27,219 INFO [M:0;jenkins-hbase4:40875] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:27,219 DEBUG [M:0;jenkins-hbase4:40875] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:27,219 DEBUG [M:0;jenkins-hbase4:40875] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:27,219 DEBUG [M:0;jenkins-hbase4:40875] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:27,219 INFO [M:0;jenkins-hbase4:40875] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-19 08:00:27,235 INFO [M:0;jenkins-hbase4:40875] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/441450d36cfb467b8e8e102171f1a41d 2023-02-19 08:00:27,241 DEBUG [M:0;jenkins-hbase4:40875] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/441450d36cfb467b8e8e102171f1a41d as hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/441450d36cfb467b8e8e102171f1a41d 2023-02-19 08:00:27,245 INFO [M:0;jenkins-hbase4:40875] regionserver.HStore(1080): Added hdfs://localhost:39511/user/jenkins/test-data/e5578bae-be0d-83bb-ce26-edb96391db14/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/441450d36cfb467b8e8e102171f1a41d, entries=31, sequenceid=218, filesize=9.0 K 2023-02-19 08:00:27,246 INFO [M:0;jenkins-hbase4:40875] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=218, compaction requested=false 2023-02-19 08:00:27,247 INFO [M:0;jenkins-hbase4:40875] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:27,247 DEBUG [M:0;jenkins-hbase4:40875] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:27,251 INFO [M:0;jenkins-hbase4:40875] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 08:00:27,251 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:27,252 INFO [M:0;jenkins-hbase4:40875] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40875 2023-02-19 08:00:27,257 DEBUG [M:0;jenkins-hbase4:40875] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40875,1676793620588 already deleted, retry=false 2023-02-19 08:00:27,312 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:27,312 INFO [RS:0;jenkins-hbase4:34367] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34367,1676793620656; zookeeper connection closed. 2023-02-19 08:00:27,312 ERROR [Listener at localhost/39595-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4ee91c16 rejected from java.util.concurrent.ThreadPoolExecutor@9085942[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:27,312 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@b3957fd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@b3957fd 2023-02-19 08:00:27,312 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): regionserver:34367-0x1006b9812040001, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:27,312 ERROR [Listener at localhost/39595-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3685eb61 rejected from java.util.concurrent.ThreadPoolExecutor@9085942[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:27,312 INFO [Listener at localhost/39595] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 08:00:27,412 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:27,412 INFO [M:0;jenkins-hbase4:40875] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40875,1676793620588; zookeeper connection closed. 2023-02-19 08:00:27,412 ERROR [Listener at localhost/39595-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3f011b2d rejected from java.util.concurrent.ThreadPoolExecutor@3b3e8815[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:27,413 DEBUG [Listener at localhost/39595-EventThread] zookeeper.ZKWatcher(600): master:40875-0x1006b9812040000, quorum=127.0.0.1:57467, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:27,413 ERROR [Listener at localhost/39595-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78e7187f rejected from java.util.concurrent.ThreadPoolExecutor@3b3e8815[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:27,504 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/hadoop-3980851052798373698.jar 2023-02-19 08:00:27,509 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676793623269 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:27,509 DEBUG [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce 2023-02-19 08:00:27,510 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(239): region to add: 6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:27,510 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(239): region to add: 2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:27,510 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(239): region to add: 27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:27,510 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(239): region to add: dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(239): region to add: 85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(239): region to add: c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(239): region to add: a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(239): region to add: d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(239): region to add: 504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(239): region to add: b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(585): clone region=6cc05be996fe008417d9c42176fe58a9 as 6cc05be996fe008417d9c42176fe58a9 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(585): clone region=2aad437ae6a0fad0ff336a7f10638fb8 as 2aad437ae6a0fad0ff336a7f10638fb8 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(585): clone region=27e7738ad5c485b9b7e82b69732bc6c8 as 27e7738ad5c485b9b7e82b69732bc6c8 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(585): clone region=dc0dcd299cf5eb6dbd5865dff9c884f2 as dc0dcd299cf5eb6dbd5865dff9c884f2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(585): clone region=85945aa15e48fc7ac5462645b71681b2 as 85945aa15e48fc7ac5462645b71681b2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(585): clone region=c8342862229610c0a5f8524ae4b36555 as c8342862229610c0a5f8524ae4b36555 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(585): clone region=a1dac72385b876179012ba21ed7a817b as a1dac72385b876179012ba21ed7a817b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(585): clone region=d21b708922c39bf74a1d1893b6dbd047 as d21b708922c39bf74a1d1893b6dbd047 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(585): clone region=504d387527886fb86472f3fb84f7fdfe as 504d387527886fb86472f3fb84f7fdfe in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:27,511 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(585): clone region=b7a69747770c2c175c780f40ecb3863b as b7a69747770c2c175c780f40ecb3863b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-19 08:00:27,512 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6cc05be996fe008417d9c42176fe58a9, NAME => 'testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,515 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2aad437ae6a0fad0ff336a7f10638fb8, NAME => 'testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,517 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => a1dac72385b876179012ba21ed7a817b, NAME => 'testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,518 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => dc0dcd299cf5eb6dbd5865dff9c884f2, NAME => 'testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,518 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => d21b708922c39bf74a1d1893b6dbd047, NAME => 'testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,518 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 85945aa15e48fc7ac5462645b71681b2, NAME => 'testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,518 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 27e7738ad5c485b9b7e82b69732bc6c8, NAME => 'testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,518 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => c8342862229610c0a5f8524ae4b36555, NAME => 'testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,528 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:27,529 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 27c24b552803407ab552e772c5c112a5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,533 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:27,533 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4694495f8e034d7db63c5e7c3818734b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,540 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a2972c510d3847498fe7ab1e46f56cac from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,540 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 70ad886b800d4a55afd103aa375b149e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,541 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:27,541 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink de9d8fb8bff74cecab74598f965c95cb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,545 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 6cc05be996fe008417d9c42176fe58a9, disabling compactions & flushes 2023-02-19 08:00:27,545 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:27,545 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:27,545 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:27,545 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. after waiting 0 ms 2023-02-19 08:00:27,545 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:27,545 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing d21b708922c39bf74a1d1893b6dbd047, disabling compactions & flushes 2023-02-19 08:00:27,545 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:27,545 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:27,545 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b1a3f2e311054e37863a24dcd5b1bb6c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,545 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:27,545 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 6cc05be996fe008417d9c42176fe58a9: 2023-02-19 08:00:27,546 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. after waiting 0 ms 2023-02-19 08:00:27,546 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:27,546 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:27,546 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for d21b708922c39bf74a1d1893b6dbd047: 2023-02-19 08:00:27,546 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 504d387527886fb86472f3fb84f7fdfe, NAME => 'testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,546 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => b7a69747770c2c175c780f40ecb3863b, NAME => 'testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,548 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 2aad437ae6a0fad0ff336a7f10638fb8, disabling compactions & flushes 2023-02-19 08:00:27,548 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:27,548 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:27,548 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. after waiting 0 ms 2023-02-19 08:00:27,548 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:27,549 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:27,549 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 2aad437ae6a0fad0ff336a7f10638fb8: 2023-02-19 08:00:27,550 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:27,550 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing a1dac72385b876179012ba21ed7a817b, disabling compactions & flushes 2023-02-19 08:00:27,550 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:27,550 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:27,550 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. after waiting 0 ms 2023-02-19 08:00:27,550 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:27,550 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 85945aa15e48fc7ac5462645b71681b2, disabling compactions & flushes 2023-02-19 08:00:27,550 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:27,550 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:27,550 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for a1dac72385b876179012ba21ed7a817b: 2023-02-19 08:00:27,550 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:27,550 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. after waiting 0 ms 2023-02-19 08:00:27,550 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:27,551 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:27,551 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 85945aa15e48fc7ac5462645b71681b2: 2023-02-19 08:00:27,554 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:27,554 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3ea87af6c07449149a1d0df22c8d201a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,558 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:27,558 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd324e006edc450c9378dea34861db4e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,559 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e0a40379a1b140b2914609a0eaaf6c0b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,562 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing dc0dcd299cf5eb6dbd5865dff9c884f2, disabling compactions & flushes 2023-02-19 08:00:27,563 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:27,563 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:27,563 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. after waiting 0 ms 2023-02-19 08:00:27,563 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:27,563 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:27,563 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for dc0dcd299cf5eb6dbd5865dff9c884f2: 2023-02-19 08:00:27,563 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 345b99abbd164f1394d19221f4d4f5ee from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,564 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:27,564 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7702669ae37c4d27bc7a88d8f0824142 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,566 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a019bf45794f456aacd4889651e28db7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,567 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 27e7738ad5c485b9b7e82b69732bc6c8, disabling compactions & flushes 2023-02-19 08:00:27,567 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:27,567 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:27,567 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. after waiting 0 ms 2023-02-19 08:00:27,567 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:27,567 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:27,567 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 27e7738ad5c485b9b7e82b69732bc6c8: 2023-02-19 08:00:27,568 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing c8342862229610c0a5f8524ae4b36555, disabling compactions & flushes 2023-02-19 08:00:27,568 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:27,568 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:27,568 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. after waiting 0 ms 2023-02-19 08:00:27,568 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:27,568 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:27,568 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for c8342862229610c0a5f8524ae4b36555: 2023-02-19 08:00:27,569 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:27,570 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2ab09dc4f1854f6b8a6dab14f8754f07 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,571 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 634bece06e854796a214ebc42f79fb2f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,573 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing b7a69747770c2c175c780f40ecb3863b, disabling compactions & flushes 2023-02-19 08:00:27,573 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:27,573 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:27,573 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. after waiting 0 ms 2023-02-19 08:00:27,573 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:27,573 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:27,573 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for b7a69747770c2c175c780f40ecb3863b: 2023-02-19 08:00:27,963 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:27,963 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9397679832aa4841a3fea958c91f94b5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,966 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6f94a02565894385824eedf8d8922f7d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-19 08:00:27,969 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 504d387527886fb86472f3fb84f7fdfe, disabling compactions & flushes 2023-02-19 08:00:27,969 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:27,969 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:27,970 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. after waiting 0 ms 2023-02-19 08:00:27,970 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:27,970 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:27,970 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 504d387527886fb86472f3fb84f7fdfe: 2023-02-19 08:00:27,970 INFO [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676793623269 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:27,970 DEBUG [Listener at localhost/39595] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,970 DEBUG [Listener at localhost/39595] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723 2023-02-19 08:00:27,971 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-data/ 2023-02-19 08:00:27,972 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----default/ 2023-02-19 08:00:27,973 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-19 08:00:27,974 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----------27e7738ad5c485b9b7e82b69732bc6c8/ 2023-02-19 08:00:27,974 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:27,974 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:27,975 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=27e7738ad5c485b9b7e82b69732bc6c8-dd324e006edc450c9378dea34861db4e 2023-02-19 08:00:27,975 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:27,976 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=27e7738ad5c485b9b7e82b69732bc6c8-345b99abbd164f1394d19221f4d4f5ee 2023-02-19 08:00:27,976 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----------2aad437ae6a0fad0ff336a7f10638fb8/ 2023-02-19 08:00:27,977 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:27,977 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:27,977 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=2aad437ae6a0fad0ff336a7f10638fb8-4694495f8e034d7db63c5e7c3818734b 2023-02-19 08:00:27,977 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:27,978 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=2aad437ae6a0fad0ff336a7f10638fb8-70ad886b800d4a55afd103aa375b149e 2023-02-19 08:00:27,978 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----------504d387527886fb86472f3fb84f7fdfe/ 2023-02-19 08:00:27,979 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:27,979 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:27,980 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=504d387527886fb86472f3fb84f7fdfe-9397679832aa4841a3fea958c91f94b5 2023-02-19 08:00:27,980 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:27,981 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=504d387527886fb86472f3fb84f7fdfe-6f94a02565894385824eedf8d8922f7d 2023-02-19 08:00:27,981 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----------6cc05be996fe008417d9c42176fe58a9/ 2023-02-19 08:00:27,981 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:27,981 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:27,982 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=6cc05be996fe008417d9c42176fe58a9-27c24b552803407ab552e772c5c112a5 2023-02-19 08:00:27,982 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:27,983 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=6cc05be996fe008417d9c42176fe58a9-a2972c510d3847498fe7ab1e46f56cac 2023-02-19 08:00:27,983 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----------85945aa15e48fc7ac5462645b71681b2/ 2023-02-19 08:00:27,983 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:27,983 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:27,984 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=85945aa15e48fc7ac5462645b71681b2-de9d8fb8bff74cecab74598f965c95cb 2023-02-19 08:00:27,984 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:27,984 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=85945aa15e48fc7ac5462645b71681b2-b1a3f2e311054e37863a24dcd5b1bb6c 2023-02-19 08:00:27,985 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----------a1dac72385b876179012ba21ed7a817b/ 2023-02-19 08:00:27,985 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:27,985 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----------b7a69747770c2c175c780f40ecb3863b/ 2023-02-19 08:00:27,986 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:27,986 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:27,986 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=b7a69747770c2c175c780f40ecb3863b-2ab09dc4f1854f6b8a6dab14f8754f07 2023-02-19 08:00:27,986 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:27,987 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=b7a69747770c2c175c780f40ecb3863b-634bece06e854796a214ebc42f79fb2f 2023-02-19 08:00:27,987 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----------c8342862229610c0a5f8524ae4b36555/ 2023-02-19 08:00:27,988 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:27,988 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:27,988 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=c8342862229610c0a5f8524ae4b36555-7702669ae37c4d27bc7a88d8f0824142 2023-02-19 08:00:27,988 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:27,989 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=c8342862229610c0a5f8524ae4b36555-a019bf45794f456aacd4889651e28db7 2023-02-19 08:00:27,989 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----------d21b708922c39bf74a1d1893b6dbd047/ 2023-02-19 08:00:27,990 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:27,990 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |----------dc0dcd299cf5eb6dbd5865dff9c884f2/ 2023-02-19 08:00:27,990 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:27,990 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:27,991 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=dc0dcd299cf5eb6dbd5865dff9c884f2-3ea87af6c07449149a1d0df22c8d201a 2023-02-19 08:00:27,991 DEBUG [Listener at localhost/39595] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:27,991 DEBUG [Listener at localhost/39595] util.CommonFSUtils(702): |----------------testWithMapReduce=dc0dcd299cf5eb6dbd5865dff9c884f2-e0a40379a1b140b2914609a0eaaf6c0b 2023-02-19 08:00:27,992 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:27,992 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:27,992 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:27,993 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:27,993 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:27,993 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:27,993 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:28,060 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/hadoop-8517526238437571161.jar 2023-02-19 08:00:28,060 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:28,061 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:28,061 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:28,061 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:28,062 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:28,062 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:28,062 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-19 08:00:28,063 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-19 08:00:28,063 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-19 08:00:28,064 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-19 08:00:28,064 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-19 08:00:28,064 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-19 08:00:28,065 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-19 08:00:28,065 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-19 08:00:28,065 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-19 08:00:28,066 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-19 08:00:28,066 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:28,067 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 08:00:28,067 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 08:00:28,067 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 08:00:28,068 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 08:00:28,133 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/hadoop-224079434947953003.jar 2023-02-19 08:00:28,134 DEBUG [Listener at localhost/39595] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 08:00:28,139 WARN [Listener at localhost/39595] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-19 08:00:28,168 INFO [Listener at localhost/39595] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 08:00:28,264 WARN [Listener at localhost/39595] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/mapreduce.cluster.local.dir/1676793628233/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-19 08:00:28,264 WARN [Listener at localhost/39595] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/mapreduce.cluster.local.dir/1676793628233/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-19 08:00:28,309 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:28,309 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:28,310 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:28,312 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:28,313 DEBUG [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f1 2023-02-19 08:00:28,313 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27e7738ad5c485b9b7e82b69732bc6c8 columnFamilyName f1 2023-02-19 08:00:28,318 DEBUG [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f1/testWithMapReduce=27e7738ad5c485b9b7e82b69732bc6c8-dd324e006edc450c9378dea34861db4e 2023-02-19 08:00:28,318 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] regionserver.HStore(310): Store=27e7738ad5c485b9b7e82b69732bc6c8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,318 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 27e7738ad5c485b9b7e82b69732bc6c8 2023-02-19 08:00:28,319 DEBUG [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f2 2023-02-19 08:00:28,320 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27e7738ad5c485b9b7e82b69732bc6c8 columnFamilyName f2 2023-02-19 08:00:28,324 DEBUG [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/27e7738ad5c485b9b7e82b69732bc6c8/f2/testWithMapReduce=27e7738ad5c485b9b7e82b69732bc6c8-345b99abbd164f1394d19221f4d4f5ee 2023-02-19 08:00:28,324 INFO [StoreOpener-27e7738ad5c485b9b7e82b69732bc6c8-1] regionserver.HStore(310): Store=27e7738ad5c485b9b7e82b69732bc6c8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,324 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:28,324 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 27e7738ad5c485b9b7e82b69732bc6c8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70050346, jitterRate=0.04383149743080139}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:28,324 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 27e7738ad5c485b9b7e82b69732bc6c8: 2023-02-19 08:00:28,355 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 27e7738ad5c485b9b7e82b69732bc6c8, disabling compactions & flushes 2023-02-19 08:00:28,355 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:28,355 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:28,355 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. after waiting 0 ms 2023-02-19 08:00:28,355 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:28,356 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676793621954.27e7738ad5c485b9b7e82b69732bc6c8. 2023-02-19 08:00:28,356 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 27e7738ad5c485b9b7e82b69732bc6c8: 2023-02-19 08:00:28,359 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:28,359 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:28,361 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:28,362 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:28,363 DEBUG [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f1 2023-02-19 08:00:28,363 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 504d387527886fb86472f3fb84f7fdfe columnFamilyName f1 2023-02-19 08:00:28,369 DEBUG [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f1/testWithMapReduce=504d387527886fb86472f3fb84f7fdfe-9397679832aa4841a3fea958c91f94b5 2023-02-19 08:00:28,369 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] regionserver.HStore(310): Store=504d387527886fb86472f3fb84f7fdfe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,369 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 504d387527886fb86472f3fb84f7fdfe 2023-02-19 08:00:28,370 DEBUG [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f2 2023-02-19 08:00:28,370 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 504d387527886fb86472f3fb84f7fdfe columnFamilyName f2 2023-02-19 08:00:28,375 DEBUG [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/504d387527886fb86472f3fb84f7fdfe/f2/testWithMapReduce=504d387527886fb86472f3fb84f7fdfe-6f94a02565894385824eedf8d8922f7d 2023-02-19 08:00:28,375 INFO [StoreOpener-504d387527886fb86472f3fb84f7fdfe-1] regionserver.HStore(310): Store=504d387527886fb86472f3fb84f7fdfe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:28,375 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 504d387527886fb86472f3fb84f7fdfe; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59223248, jitterRate=-0.11750483512878418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:28,375 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 504d387527886fb86472f3fb84f7fdfe: 2023-02-19 08:00:28,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 504d387527886fb86472f3fb84f7fdfe, disabling compactions & flushes 2023-02-19 08:00:28,409 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:28,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:28,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. after waiting 0 ms 2023-02-19 08:00:28,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:28,410 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676793621954.504d387527886fb86472f3fb84f7fdfe. 2023-02-19 08:00:28,410 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 504d387527886fb86472f3fb84f7fdfe: 2023-02-19 08:00:28,416 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:28,416 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:28,417 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:28,419 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:28,420 DEBUG [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f1 2023-02-19 08:00:28,420 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2aad437ae6a0fad0ff336a7f10638fb8 columnFamilyName f1 2023-02-19 08:00:28,425 DEBUG [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f1/testWithMapReduce=2aad437ae6a0fad0ff336a7f10638fb8-4694495f8e034d7db63c5e7c3818734b 2023-02-19 08:00:28,425 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] regionserver.HStore(310): Store=2aad437ae6a0fad0ff336a7f10638fb8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,425 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2aad437ae6a0fad0ff336a7f10638fb8 2023-02-19 08:00:28,426 DEBUG [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f2 2023-02-19 08:00:28,426 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2aad437ae6a0fad0ff336a7f10638fb8 columnFamilyName f2 2023-02-19 08:00:28,432 DEBUG [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/2aad437ae6a0fad0ff336a7f10638fb8/f2/testWithMapReduce=2aad437ae6a0fad0ff336a7f10638fb8-70ad886b800d4a55afd103aa375b149e 2023-02-19 08:00:28,432 INFO [StoreOpener-2aad437ae6a0fad0ff336a7f10638fb8-1] regionserver.HStore(310): Store=2aad437ae6a0fad0ff336a7f10638fb8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,432 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:28,432 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2aad437ae6a0fad0ff336a7f10638fb8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66732651, jitterRate=-0.005606010556221008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:28,432 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2aad437ae6a0fad0ff336a7f10638fb8: 2023-02-19 08:00:28,461 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2aad437ae6a0fad0ff336a7f10638fb8, disabling compactions & flushes 2023-02-19 08:00:28,461 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:28,462 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:28,462 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. after waiting 0 ms 2023-02-19 08:00:28,462 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:28,464 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676793621954.2aad437ae6a0fad0ff336a7f10638fb8. 2023-02-19 08:00:28,464 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2aad437ae6a0fad0ff336a7f10638fb8: 2023-02-19 08:00:28,468 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:28,468 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:28,481 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:28,483 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:28,484 DEBUG [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f1 2023-02-19 08:00:28,484 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cc05be996fe008417d9c42176fe58a9 columnFamilyName f1 2023-02-19 08:00:28,489 DEBUG [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f1/testWithMapReduce=6cc05be996fe008417d9c42176fe58a9-27c24b552803407ab552e772c5c112a5 2023-02-19 08:00:28,490 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] regionserver.HStore(310): Store=6cc05be996fe008417d9c42176fe58a9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,490 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6cc05be996fe008417d9c42176fe58a9 2023-02-19 08:00:28,491 DEBUG [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f2 2023-02-19 08:00:28,491 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6cc05be996fe008417d9c42176fe58a9 columnFamilyName f2 2023-02-19 08:00:28,495 DEBUG [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/6cc05be996fe008417d9c42176fe58a9/f2/testWithMapReduce=6cc05be996fe008417d9c42176fe58a9-a2972c510d3847498fe7ab1e46f56cac 2023-02-19 08:00:28,495 INFO [StoreOpener-6cc05be996fe008417d9c42176fe58a9-1] regionserver.HStore(310): Store=6cc05be996fe008417d9c42176fe58a9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,496 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:28,496 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6cc05be996fe008417d9c42176fe58a9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59609059, jitterRate=-0.11175580322742462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:28,496 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6cc05be996fe008417d9c42176fe58a9: 2023-02-19 08:00:28,533 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6cc05be996fe008417d9c42176fe58a9, disabling compactions & flushes 2023-02-19 08:00:28,534 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:28,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:28,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. after waiting 0 ms 2023-02-19 08:00:28,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:28,535 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676793621954.6cc05be996fe008417d9c42176fe58a9. 2023-02-19 08:00:28,535 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6cc05be996fe008417d9c42176fe58a9: 2023-02-19 08:00:28,538 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:28,538 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:28,539 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:28,541 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:28,542 DEBUG [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f1 2023-02-19 08:00:28,542 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85945aa15e48fc7ac5462645b71681b2 columnFamilyName f1 2023-02-19 08:00:28,546 DEBUG [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f1/testWithMapReduce=85945aa15e48fc7ac5462645b71681b2-de9d8fb8bff74cecab74598f965c95cb 2023-02-19 08:00:28,547 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] regionserver.HStore(310): Store=85945aa15e48fc7ac5462645b71681b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,547 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 85945aa15e48fc7ac5462645b71681b2 2023-02-19 08:00:28,548 DEBUG [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f2 2023-02-19 08:00:28,548 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85945aa15e48fc7ac5462645b71681b2 columnFamilyName f2 2023-02-19 08:00:28,552 DEBUG [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/85945aa15e48fc7ac5462645b71681b2/f2/testWithMapReduce=85945aa15e48fc7ac5462645b71681b2-b1a3f2e311054e37863a24dcd5b1bb6c 2023-02-19 08:00:28,552 INFO [StoreOpener-85945aa15e48fc7ac5462645b71681b2-1] regionserver.HStore(310): Store=85945aa15e48fc7ac5462645b71681b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,553 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:28,553 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 85945aa15e48fc7ac5462645b71681b2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66656823, jitterRate=-0.006735935807228088}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:28,553 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 85945aa15e48fc7ac5462645b71681b2: 2023-02-19 08:00:28,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 85945aa15e48fc7ac5462645b71681b2, disabling compactions & flushes 2023-02-19 08:00:28,579 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:28,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:28,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. after waiting 0 ms 2023-02-19 08:00:28,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:28,580 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676793621954.85945aa15e48fc7ac5462645b71681b2. 2023-02-19 08:00:28,580 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 85945aa15e48fc7ac5462645b71681b2: 2023-02-19 08:00:28,583 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:28,583 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:28,585 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:28,587 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:28,588 DEBUG [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f1 2023-02-19 08:00:28,588 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7a69747770c2c175c780f40ecb3863b columnFamilyName f1 2023-02-19 08:00:28,593 DEBUG [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f1/testWithMapReduce=b7a69747770c2c175c780f40ecb3863b-2ab09dc4f1854f6b8a6dab14f8754f07 2023-02-19 08:00:28,593 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] regionserver.HStore(310): Store=b7a69747770c2c175c780f40ecb3863b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,594 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b7a69747770c2c175c780f40ecb3863b 2023-02-19 08:00:28,595 DEBUG [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f2 2023-02-19 08:00:28,595 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7a69747770c2c175c780f40ecb3863b columnFamilyName f2 2023-02-19 08:00:28,601 DEBUG [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/b7a69747770c2c175c780f40ecb3863b/f2/testWithMapReduce=b7a69747770c2c175c780f40ecb3863b-634bece06e854796a214ebc42f79fb2f 2023-02-19 08:00:28,601 INFO [StoreOpener-b7a69747770c2c175c780f40ecb3863b-1] regionserver.HStore(310): Store=b7a69747770c2c175c780f40ecb3863b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,601 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:28,601 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b7a69747770c2c175c780f40ecb3863b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64668292, jitterRate=-0.03636735677719116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:28,601 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b7a69747770c2c175c780f40ecb3863b: 2023-02-19 08:00:28,632 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b7a69747770c2c175c780f40ecb3863b, disabling compactions & flushes 2023-02-19 08:00:28,633 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:28,633 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:28,633 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. after waiting 0 ms 2023-02-19 08:00:28,633 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:28,633 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676793621954.b7a69747770c2c175c780f40ecb3863b. 2023-02-19 08:00:28,634 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b7a69747770c2c175c780f40ecb3863b: 2023-02-19 08:00:28,636 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:28,636 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:28,638 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:28,640 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:28,641 DEBUG [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b/f1 2023-02-19 08:00:28,641 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1dac72385b876179012ba21ed7a817b columnFamilyName f1 2023-02-19 08:00:28,642 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] regionserver.HStore(310): Store=a1dac72385b876179012ba21ed7a817b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,642 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a1dac72385b876179012ba21ed7a817b 2023-02-19 08:00:28,643 DEBUG [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/a1dac72385b876179012ba21ed7a817b/f2 2023-02-19 08:00:28,643 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1dac72385b876179012ba21ed7a817b columnFamilyName f2 2023-02-19 08:00:28,644 INFO [StoreOpener-a1dac72385b876179012ba21ed7a817b-1] regionserver.HStore(310): Store=a1dac72385b876179012ba21ed7a817b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,644 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:28,644 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a1dac72385b876179012ba21ed7a817b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69764691, jitterRate=0.03957490622997284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:28,644 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a1dac72385b876179012ba21ed7a817b: 2023-02-19 08:00:28,661 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a1dac72385b876179012ba21ed7a817b, disabling compactions & flushes 2023-02-19 08:00:28,661 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:28,661 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:28,661 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. after waiting 0 ms 2023-02-19 08:00:28,661 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:28,662 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793621954.a1dac72385b876179012ba21ed7a817b. 2023-02-19 08:00:28,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a1dac72385b876179012ba21ed7a817b: 2023-02-19 08:00:28,664 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:28,665 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:28,666 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:28,667 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:28,668 DEBUG [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f1 2023-02-19 08:00:28,668 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc0dcd299cf5eb6dbd5865dff9c884f2 columnFamilyName f1 2023-02-19 08:00:28,672 DEBUG [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f1/testWithMapReduce=dc0dcd299cf5eb6dbd5865dff9c884f2-3ea87af6c07449149a1d0df22c8d201a 2023-02-19 08:00:28,673 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] regionserver.HStore(310): Store=dc0dcd299cf5eb6dbd5865dff9c884f2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,673 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dc0dcd299cf5eb6dbd5865dff9c884f2 2023-02-19 08:00:28,673 DEBUG [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f2 2023-02-19 08:00:28,674 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc0dcd299cf5eb6dbd5865dff9c884f2 columnFamilyName f2 2023-02-19 08:00:28,677 DEBUG [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/dc0dcd299cf5eb6dbd5865dff9c884f2/f2/testWithMapReduce=dc0dcd299cf5eb6dbd5865dff9c884f2-e0a40379a1b140b2914609a0eaaf6c0b 2023-02-19 08:00:28,678 INFO [StoreOpener-dc0dcd299cf5eb6dbd5865dff9c884f2-1] regionserver.HStore(310): Store=dc0dcd299cf5eb6dbd5865dff9c884f2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,678 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:28,678 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dc0dcd299cf5eb6dbd5865dff9c884f2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73957971, jitterRate=0.10205964744091034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:28,678 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dc0dcd299cf5eb6dbd5865dff9c884f2: 2023-02-19 08:00:28,715 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dc0dcd299cf5eb6dbd5865dff9c884f2, disabling compactions & flushes 2023-02-19 08:00:28,715 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:28,715 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:28,715 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. after waiting 0 ms 2023-02-19 08:00:28,716 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:28,716 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676793621954.dc0dcd299cf5eb6dbd5865dff9c884f2. 2023-02-19 08:00:28,716 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dc0dcd299cf5eb6dbd5865dff9c884f2: 2023-02-19 08:00:28,719 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:28,719 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:28,720 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:28,721 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:28,723 DEBUG [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047/f1 2023-02-19 08:00:28,723 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d21b708922c39bf74a1d1893b6dbd047 columnFamilyName f1 2023-02-19 08:00:28,723 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] regionserver.HStore(310): Store=d21b708922c39bf74a1d1893b6dbd047/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,724 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d21b708922c39bf74a1d1893b6dbd047 2023-02-19 08:00:28,725 DEBUG [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/d21b708922c39bf74a1d1893b6dbd047/f2 2023-02-19 08:00:28,725 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d21b708922c39bf74a1d1893b6dbd047 columnFamilyName f2 2023-02-19 08:00:28,726 INFO [StoreOpener-d21b708922c39bf74a1d1893b6dbd047-1] regionserver.HStore(310): Store=d21b708922c39bf74a1d1893b6dbd047/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,726 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:28,726 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d21b708922c39bf74a1d1893b6dbd047; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60726055, jitterRate=-0.09511126577854156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:28,726 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d21b708922c39bf74a1d1893b6dbd047: 2023-02-19 08:00:28,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d21b708922c39bf74a1d1893b6dbd047, disabling compactions & flushes 2023-02-19 08:00:28,743 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:28,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:28,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. after waiting 0 ms 2023-02-19 08:00:28,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:28,743 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676793621954.d21b708922c39bf74a1d1893b6dbd047. 2023-02-19 08:00:28,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d21b708922c39bf74a1d1893b6dbd047: 2023-02-19 08:00:28,746 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:28,746 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:28,748 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:28,750 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:28,751 DEBUG [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f1 2023-02-19 08:00:28,751 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8342862229610c0a5f8524ae4b36555 columnFamilyName f1 2023-02-19 08:00:28,755 DEBUG [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f1/testWithMapReduce=c8342862229610c0a5f8524ae4b36555-7702669ae37c4d27bc7a88d8f0824142 2023-02-19 08:00:28,756 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] regionserver.HStore(310): Store=c8342862229610c0a5f8524ae4b36555/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,756 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c8342862229610c0a5f8524ae4b36555 2023-02-19 08:00:28,756 DEBUG [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f2 2023-02-19 08:00:28,757 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8342862229610c0a5f8524ae4b36555 columnFamilyName f2 2023-02-19 08:00:28,761 DEBUG [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] regionserver.HStore(539): loaded hdfs://localhost:39511/user/jenkins/test-data/df76ea07-1138-933d-9295-73a55c838f73/testWithMapReduceAndOfflineHBaseMultiRegion/c7b88456-51e6-4732-b3e1-6cd4ea820723/data/default/testWithMapReduce/c8342862229610c0a5f8524ae4b36555/f2/testWithMapReduce=c8342862229610c0a5f8524ae4b36555-a019bf45794f456aacd4889651e28db7 2023-02-19 08:00:28,761 INFO [StoreOpener-c8342862229610c0a5f8524ae4b36555-1] regionserver.HStore(310): Store=c8342862229610c0a5f8524ae4b36555/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:28,762 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:28,762 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c8342862229610c0a5f8524ae4b36555; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73531603, jitterRate=0.0957062691450119}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:28,762 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c8342862229610c0a5f8524ae4b36555: 2023-02-19 08:00:28,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c8342862229610c0a5f8524ae4b36555, disabling compactions & flushes 2023-02-19 08:00:28,792 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:28,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:28,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. after waiting 0 ms 2023-02-19 08:00:28,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:28,798 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676793621954.c8342862229610c0a5f8524ae4b36555. 2023-02-19 08:00:28,798 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c8342862229610c0a5f8524ae4b36555: 2023-02-19 08:00:29,311 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 08:00:29,312 WARN [Listener at localhost/39595] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:29,316 INFO [Listener at localhost/39595] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:29,420 WARN [BP-290105228-172.31.14.131-1676793619915 heartbeating to localhost/127.0.0.1:39511] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:29,422 WARN [BP-290105228-172.31.14.131-1676793619915 heartbeating to localhost/127.0.0.1:39511] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-290105228-172.31.14.131-1676793619915 (Datanode Uuid e07f2d53-c7d0-48e2-aeae-dd8fdda1065e) service to localhost/127.0.0.1:39511 2023-02-19 08:00:29,422 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/cluster_1f3c0ce0-6f1b-8ef9-4e13-dac23946ce5c/dfs/data/data3/current/BP-290105228-172.31.14.131-1676793619915] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:29,423 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/cluster_1f3c0ce0-6f1b-8ef9-4e13-dac23946ce5c/dfs/data/data4/current/BP-290105228-172.31.14.131-1676793619915] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:29,424 WARN [Listener at localhost/39595] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:29,428 INFO [Listener at localhost/39595] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:29,530 WARN [BP-290105228-172.31.14.131-1676793619915 heartbeating to localhost/127.0.0.1:39511] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:29,530 WARN [BP-290105228-172.31.14.131-1676793619915 heartbeating to localhost/127.0.0.1:39511] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-290105228-172.31.14.131-1676793619915 (Datanode Uuid c7452db0-d8e3-4210-b8fd-e54ec4ca32dc) service to localhost/127.0.0.1:39511 2023-02-19 08:00:29,531 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/cluster_1f3c0ce0-6f1b-8ef9-4e13-dac23946ce5c/dfs/data/data1/current/BP-290105228-172.31.14.131-1676793619915] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:29,531 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/cluster_1f3c0ce0-6f1b-8ef9-4e13-dac23946ce5c/dfs/data/data2/current/BP-290105228-172.31.14.131-1676793619915] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:29,542 INFO [Listener at localhost/39595] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:29,662 INFO [Listener at localhost/39595] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 08:00:29,705 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 08:00:29,718 INFO [Listener at localhost/39595] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=154 (was 103) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: (jenkins-hbase4.apache.org,40875,1676793620588)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:39511 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:39511 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:39511 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:39511 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39595 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39511 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:39511 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:39511 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=534 (was 539), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=405 (was 341) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=9454 (was 9999) 2023-02-19 08:00:29,728 INFO [Listener at localhost/39595] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=154, OpenFileDescriptor=534, MaxFileDescriptor=60000, SystemLoadAverage=405, ProcessCount=170, AvailableMemoryMB=9453 2023-02-19 08:00:29,739 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/hadoop.log.dir so I do NOT create it in target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7 2023-02-19 08:00:29,739 WARN [Listener at localhost/39595] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 08:00:29,739 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/hadoop.tmp.dir so I do NOT create it in target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7 2023-02-19 08:00:29,739 WARN [Listener at localhost/39595] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9f655639-dc65-d822-8726-136211c882de/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 08:00:29,739 DEBUG [Listener at localhost/39595] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7 2023-02-19 08:00:29,739 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 08:00:29,739 INFO [Listener at localhost/39595] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/cluster_3412e0af-2a47-9c62-bf1d-3572be45fe3d, deleteOnExit=true 2023-02-19 08:00:29,739 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 08:00:29,739 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/test.cache.data in system properties and HBase conf 2023-02-19 08:00:29,739 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 08:00:29,739 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/hadoop.log.dir in system properties and HBase conf 2023-02-19 08:00:29,739 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 08:00:29,740 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 08:00:29,740 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 08:00:29,740 DEBUG [Listener at localhost/39595] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 08:00:29,740 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:29,740 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:29,740 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 08:00:29,740 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:29,740 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 08:00:29,740 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 08:00:29,741 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:29,741 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:29,741 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 08:00:29,741 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/nfs.dump.dir in system properties and HBase conf 2023-02-19 08:00:29,741 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/java.io.tmpdir in system properties and HBase conf 2023-02-19 08:00:29,741 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:29,741 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 08:00:29,741 INFO [Listener at localhost/39595] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 08:00:29,745 WARN [Listener at localhost/39595] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:29,745 WARN [Listener at localhost/39595] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:29,785 WARN [Listener at localhost/39595] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:29,787 INFO [Listener at localhost/39595] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:29,792 INFO [Listener at localhost/39595] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/java.io.tmpdir/Jetty_localhost_44223_hdfs____.vhkjqb/webapp 2023-02-19 08:00:29,885 INFO [Listener at localhost/39595] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44223 2023-02-19 08:00:29,890 WARN [Listener at localhost/39595] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:29,890 WARN [Listener at localhost/39595] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:29,935 WARN [Listener at localhost/44751] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:29,951 WARN [Listener at localhost/44751] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:29,954 WARN [Listener at localhost/44751] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:29,955 INFO [Listener at localhost/44751] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:29,960 INFO [Listener at localhost/44751] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/java.io.tmpdir/Jetty_localhost_43287_datanode____7um2ex/webapp 2023-02-19 08:00:30,067 INFO [Listener at localhost/44751] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43287 2023-02-19 08:00:30,082 WARN [Listener at localhost/36929] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:30,109 WARN [Listener at localhost/36929] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:30,114 WARN [Listener at localhost/36929] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:30,116 INFO [Listener at localhost/36929] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:30,131 INFO [Listener at localhost/36929] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/java.io.tmpdir/Jetty_localhost_45707_datanode____.ukvsjg/webapp 2023-02-19 08:00:30,223 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc4e09355b8c1571d: Processing first storage report for DS-ba0244cf-9731-4c1e-97dd-b19d4465cb3f from datanode a91802e6-d4c8-410a-be9b-2462da7ae464 2023-02-19 08:00:30,223 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc4e09355b8c1571d: from storage DS-ba0244cf-9731-4c1e-97dd-b19d4465cb3f node DatanodeRegistration(127.0.0.1:45871, datanodeUuid=a91802e6-d4c8-410a-be9b-2462da7ae464, infoPort=37619, infoSecurePort=0, ipcPort=36929, storageInfo=lv=-57;cid=testClusterID;nsid=1323219906;c=1676793629748), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:30,223 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc4e09355b8c1571d: Processing first storage report for DS-414ea398-2cbc-4260-91e4-b36792444829 from datanode a91802e6-d4c8-410a-be9b-2462da7ae464 2023-02-19 08:00:30,223 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc4e09355b8c1571d: from storage DS-414ea398-2cbc-4260-91e4-b36792444829 node DatanodeRegistration(127.0.0.1:45871, datanodeUuid=a91802e6-d4c8-410a-be9b-2462da7ae464, infoPort=37619, infoSecurePort=0, ipcPort=36929, storageInfo=lv=-57;cid=testClusterID;nsid=1323219906;c=1676793629748), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:30,269 INFO [Listener at localhost/36929] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45707 2023-02-19 08:00:30,278 WARN [Listener at localhost/35513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:30,366 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d7469ad842d36d3: Processing first storage report for DS-9ed621e7-059c-4181-9c75-dca20f2c6aa1 from datanode 6cb33856-b7a0-4bfa-8a3a-a322c4cb445e 2023-02-19 08:00:30,367 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d7469ad842d36d3: from storage DS-9ed621e7-059c-4181-9c75-dca20f2c6aa1 node DatanodeRegistration(127.0.0.1:45823, datanodeUuid=6cb33856-b7a0-4bfa-8a3a-a322c4cb445e, infoPort=36281, infoSecurePort=0, ipcPort=35513, storageInfo=lv=-57;cid=testClusterID;nsid=1323219906;c=1676793629748), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:30,367 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d7469ad842d36d3: Processing first storage report for DS-b278c998-73cf-43b5-9a52-6c1d33e2a69e from datanode 6cb33856-b7a0-4bfa-8a3a-a322c4cb445e 2023-02-19 08:00:30,367 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d7469ad842d36d3: from storage DS-b278c998-73cf-43b5-9a52-6c1d33e2a69e node DatanodeRegistration(127.0.0.1:45823, datanodeUuid=6cb33856-b7a0-4bfa-8a3a-a322c4cb445e, infoPort=36281, infoSecurePort=0, ipcPort=35513, storageInfo=lv=-57;cid=testClusterID;nsid=1323219906;c=1676793629748), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:30,384 DEBUG [Listener at localhost/35513] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7 2023-02-19 08:00:30,386 INFO [Listener at localhost/35513] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/cluster_3412e0af-2a47-9c62-bf1d-3572be45fe3d/zookeeper_0, clientPort=64022, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/cluster_3412e0af-2a47-9c62-bf1d-3572be45fe3d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/cluster_3412e0af-2a47-9c62-bf1d-3572be45fe3d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 08:00:30,388 INFO [Listener at localhost/35513] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64022 2023-02-19 08:00:30,388 INFO [Listener at localhost/35513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,390 INFO [Listener at localhost/35513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,403 INFO [Listener at localhost/35513] util.FSUtils(479): Created version file at hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0 with version=8 2023-02-19 08:00:30,403 INFO [Listener at localhost/35513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,404 INFO [Listener at localhost/35513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,406 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44751/user/jenkins/test-data/2445e0a5-b96f-9440-da07-1d114feefc44/hbase-staging 2023-02-19 08:00:30,408 INFO [Listener at localhost/35513] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:30,408 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:30,408 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:30,408 INFO [Listener at localhost/35513] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:30,409 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:30,409 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:30,409 INFO [Listener at localhost/35513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:30,415 INFO [Listener at localhost/35513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40515 2023-02-19 08:00:30,415 INFO [Listener at localhost/35513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,416 INFO [Listener at localhost/35513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,417 INFO [Listener at localhost/35513] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40515 connecting to ZooKeeper ensemble=127.0.0.1:64022 2023-02-19 08:00:30,429 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:405150x0, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:30,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40515-0x1006b9838770000 connected 2023-02-19 08:00:30,449 DEBUG [Listener at localhost/35513] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:30,450 DEBUG [Listener at localhost/35513] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:30,450 DEBUG [Listener at localhost/35513] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:30,451 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40515 2023-02-19 08:00:30,451 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40515 2023-02-19 08:00:30,452 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40515 2023-02-19 08:00:30,452 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40515 2023-02-19 08:00:30,453 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40515 2023-02-19 08:00:30,453 INFO [Listener at localhost/35513] master.HMaster(444): hbase.rootdir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0, hbase.cluster.distributed=false 2023-02-19 08:00:30,472 INFO [Listener at localhost/35513] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:30,472 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:30,472 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:30,472 INFO [Listener at localhost/35513] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:30,472 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:30,473 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:30,473 INFO [Listener at localhost/35513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:30,476 INFO [Listener at localhost/35513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35779 2023-02-19 08:00:30,476 INFO [Listener at localhost/35513] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:30,477 DEBUG [Listener at localhost/35513] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:30,478 INFO [Listener at localhost/35513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,479 INFO [Listener at localhost/35513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,480 INFO [Listener at localhost/35513] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35779 connecting to ZooKeeper ensemble=127.0.0.1:64022 2023-02-19 08:00:30,483 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:357790x0, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:30,485 DEBUG [Listener at localhost/35513] zookeeper.ZKUtil(164): regionserver:357790x0, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:30,486 DEBUG [Listener at localhost/35513] zookeeper.ZKUtil(164): regionserver:357790x0, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:30,487 DEBUG [Listener at localhost/35513] zookeeper.ZKUtil(164): regionserver:357790x0, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:30,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35779-0x1006b9838770001 connected 2023-02-19 08:00:30,493 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35779 2023-02-19 08:00:30,493 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35779 2023-02-19 08:00:30,494 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35779 2023-02-19 08:00:30,494 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35779 2023-02-19 08:00:30,495 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35779 2023-02-19 08:00:30,507 INFO [Listener at localhost/35513] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:30,507 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:30,507 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:30,507 INFO [Listener at localhost/35513] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:30,508 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:30,508 INFO [Listener at localhost/35513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:30,508 INFO [Listener at localhost/35513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:30,509 INFO [Listener at localhost/35513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42125 2023-02-19 08:00:30,510 INFO [Listener at localhost/35513] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:30,511 DEBUG [Listener at localhost/35513] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:30,511 INFO [Listener at localhost/35513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,512 INFO [Listener at localhost/35513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,513 INFO [Listener at localhost/35513] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42125 connecting to ZooKeeper ensemble=127.0.0.1:64022 2023-02-19 08:00:30,516 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:421250x0, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:30,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42125-0x1006b9838770002 connected 2023-02-19 08:00:30,520 DEBUG [Listener at localhost/35513] zookeeper.ZKUtil(164): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:30,520 DEBUG [Listener at localhost/35513] zookeeper.ZKUtil(164): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:30,521 DEBUG [Listener at localhost/35513] zookeeper.ZKUtil(164): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:30,523 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42125 2023-02-19 08:00:30,523 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42125 2023-02-19 08:00:30,524 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42125 2023-02-19 08:00:30,528 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42125 2023-02-19 08:00:30,529 DEBUG [Listener at localhost/35513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42125 2023-02-19 08:00:30,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40515,1676793630408 2023-02-19 08:00:30,533 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:30,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40515,1676793630408 2023-02-19 08:00:30,535 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:30,535 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:30,535 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:30,536 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:30,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:30,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40515,1676793630408 from backup master directory 2023-02-19 08:00:30,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:30,539 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40515,1676793630408 2023-02-19 08:00:30,539 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:30,539 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:30,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40515,1676793630408 2023-02-19 08:00:30,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/hbase.id with ID: 1a773641-ad43-42d5-9db0-02b0f656762c 2023-02-19 08:00:30,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:30,567 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:30,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1f827c8e to 127.0.0.1:64022 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:30,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@517e86a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:30,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:30,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 08:00:30,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:30,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/data/master/store-tmp 2023-02-19 08:00:30,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:30,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:30,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:30,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:30,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:30,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:30,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:30,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:30,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/WALs/jenkins-hbase4.apache.org,40515,1676793630408 2023-02-19 08:00:30,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40515%2C1676793630408, suffix=, logDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/WALs/jenkins-hbase4.apache.org,40515,1676793630408, archiveDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/oldWALs, maxLogs=10 2023-02-19 08:00:30,630 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45823,DS-9ed621e7-059c-4181-9c75-dca20f2c6aa1,DISK] 2023-02-19 08:00:30,630 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45871,DS-ba0244cf-9731-4c1e-97dd-b19d4465cb3f,DISK] 2023-02-19 08:00:30,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/WALs/jenkins-hbase4.apache.org,40515,1676793630408/jenkins-hbase4.apache.org%2C40515%2C1676793630408.1676793630614 2023-02-19 08:00:30,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45823,DS-9ed621e7-059c-4181-9c75-dca20f2c6aa1,DISK], DatanodeInfoWithStorage[127.0.0.1:45871,DS-ba0244cf-9731-4c1e-97dd-b19d4465cb3f,DISK]] 2023-02-19 08:00:30,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:30,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:30,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:30,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:30,634 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:30,635 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 08:00:30,635 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 08:00:30,635 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:30,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:30,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:30,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:30,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:30,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62472404, jitterRate=-0.0690886378288269}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:30,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:30,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 08:00:30,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 08:00:30,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 08:00:30,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 08:00:30,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 08:00:30,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 08:00:30,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 08:00:30,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 08:00:30,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 08:00:30,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 08:00:30,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 08:00:30,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 08:00:30,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 08:00:30,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 08:00:30,656 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:30,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 08:00:30,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 08:00:30,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 08:00:30,659 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:30,659 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:30,659 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:30,659 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:30,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40515,1676793630408, sessionid=0x1006b9838770000, setting cluster-up flag (Was=false) 2023-02-19 08:00:30,664 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:30,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 08:00:30,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40515,1676793630408 2023-02-19 08:00:30,671 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:30,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 08:00:30,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40515,1676793630408 2023-02-19 08:00:30,677 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.hbase-snapshot/.tmp 2023-02-19 08:00:30,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:30,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:30,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:30,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:30,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:30,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 08:00:30,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:30,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676793660683 2023-02-19 08:00:30,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 08:00:30,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 08:00:30,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 08:00:30,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 08:00:30,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 08:00:30,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 08:00:30,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,683 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:30,684 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 08:00:30,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 08:00:30,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 08:00:30,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 08:00:30,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 08:00:30,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 08:00:30,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793630684,5,FailOnTimeoutGroup] 2023-02-19 08:00:30,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793630685,5,FailOnTimeoutGroup] 2023-02-19 08:00:30,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 08:00:30,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,685 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:30,693 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:30,694 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:30,694 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0 2023-02-19 08:00:30,699 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:30,700 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:30,701 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/info 2023-02-19 08:00:30,702 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:30,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:30,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:30,703 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:30,704 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:30,704 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:30,704 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:30,705 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/table 2023-02-19 08:00:30,705 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:30,706 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:30,706 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740 2023-02-19 08:00:30,706 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740 2023-02-19 08:00:30,708 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:30,709 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:30,711 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:30,711 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62473063, jitterRate=-0.06907881796360016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:30,711 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:30,711 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:30,711 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:30,711 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:30,711 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:30,711 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:30,712 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:30,712 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:30,713 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:30,713 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 08:00:30,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 08:00:30,715 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 08:00:30,717 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 08:00:30,731 INFO [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(952): ClusterId : 1a773641-ad43-42d5-9db0-02b0f656762c 2023-02-19 08:00:30,731 INFO [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(952): ClusterId : 1a773641-ad43-42d5-9db0-02b0f656762c 2023-02-19 08:00:30,731 DEBUG [RS:1;jenkins-hbase4:42125] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:30,731 DEBUG [RS:0;jenkins-hbase4:35779] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:30,733 DEBUG [RS:1;jenkins-hbase4:42125] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:30,733 DEBUG [RS:1;jenkins-hbase4:42125] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:30,733 DEBUG [RS:0;jenkins-hbase4:35779] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:30,733 DEBUG [RS:0;jenkins-hbase4:35779] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:30,738 DEBUG [RS:0;jenkins-hbase4:35779] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:30,739 DEBUG [RS:0;jenkins-hbase4:35779] zookeeper.ReadOnlyZKClient(139): Connect 0x5e6a1ade to 127.0.0.1:64022 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:30,739 DEBUG [RS:1;jenkins-hbase4:42125] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:30,741 DEBUG [RS:1;jenkins-hbase4:42125] zookeeper.ReadOnlyZKClient(139): Connect 0x20cdf4b4 to 127.0.0.1:64022 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:30,759 DEBUG [RS:0;jenkins-hbase4:35779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50adff63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:30,760 DEBUG [RS:1;jenkins-hbase4:42125] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e0a1edd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:30,760 DEBUG [RS:0;jenkins-hbase4:35779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@549271ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:30,760 DEBUG [RS:1;jenkins-hbase4:42125] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a359fc4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:30,770 DEBUG [RS:0;jenkins-hbase4:35779] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35779 2023-02-19 08:00:30,770 INFO [RS:0;jenkins-hbase4:35779] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:30,770 INFO [RS:0;jenkins-hbase4:35779] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:30,770 DEBUG [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:30,770 DEBUG [RS:1;jenkins-hbase4:42125] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42125 2023-02-19 08:00:30,771 INFO [RS:1;jenkins-hbase4:42125] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:30,771 INFO [RS:1;jenkins-hbase4:42125] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:30,771 DEBUG [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:30,771 INFO [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40515,1676793630408 with isa=jenkins-hbase4.apache.org/172.31.14.131:35779, startcode=1676793630471 2023-02-19 08:00:30,771 DEBUG [RS:0;jenkins-hbase4:35779] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:30,771 INFO [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40515,1676793630408 with isa=jenkins-hbase4.apache.org/172.31.14.131:42125, startcode=1676793630507 2023-02-19 08:00:30,771 DEBUG [RS:1;jenkins-hbase4:42125] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:30,773 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33009, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:30,773 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37051, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:30,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40515] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:30,775 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:30,776 DEBUG [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0 2023-02-19 08:00:30,776 DEBUG [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44751 2023-02-19 08:00:30,776 DEBUG [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:30,776 DEBUG [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0 2023-02-19 08:00:30,776 DEBUG [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44751 2023-02-19 08:00:30,776 DEBUG [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:30,779 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:30,783 DEBUG [RS:1;jenkins-hbase4:42125] zookeeper.ZKUtil(162): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:30,783 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42125,1676793630507] 2023-02-19 08:00:30,783 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35779,1676793630471] 2023-02-19 08:00:30,783 WARN [RS:1;jenkins-hbase4:42125] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:30,783 DEBUG [RS:0;jenkins-hbase4:35779] zookeeper.ZKUtil(162): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:30,783 INFO [RS:1;jenkins-hbase4:42125] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:30,783 WARN [RS:0;jenkins-hbase4:35779] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:30,783 DEBUG [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/WALs/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:30,783 INFO [RS:0;jenkins-hbase4:35779] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:30,783 DEBUG [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/WALs/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:30,788 DEBUG [RS:1;jenkins-hbase4:42125] zookeeper.ZKUtil(162): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:30,788 DEBUG [RS:0;jenkins-hbase4:35779] zookeeper.ZKUtil(162): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:30,788 DEBUG [RS:1;jenkins-hbase4:42125] zookeeper.ZKUtil(162): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:30,788 DEBUG [RS:0;jenkins-hbase4:35779] zookeeper.ZKUtil(162): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:30,789 DEBUG [RS:0;jenkins-hbase4:35779] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:30,789 DEBUG [RS:1;jenkins-hbase4:42125] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:30,789 INFO [RS:0;jenkins-hbase4:35779] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:30,789 INFO [RS:1;jenkins-hbase4:42125] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:30,825 INFO [RS:0;jenkins-hbase4:35779] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:30,826 INFO [RS:0;jenkins-hbase4:35779] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:30,826 INFO [RS:0;jenkins-hbase4:35779] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,828 INFO [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:30,831 INFO [RS:1;jenkins-hbase4:42125] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:30,832 INFO [RS:0;jenkins-hbase4:35779] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,832 INFO [RS:1;jenkins-hbase4:42125] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:30,832 INFO [RS:1;jenkins-hbase4:42125] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,832 DEBUG [RS:0;jenkins-hbase4:35779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,832 DEBUG [RS:0;jenkins-hbase4:35779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,832 DEBUG [RS:0;jenkins-hbase4:35779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,832 DEBUG [RS:0;jenkins-hbase4:35779] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,832 DEBUG [RS:0;jenkins-hbase4:35779] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,833 DEBUG [RS:0;jenkins-hbase4:35779] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:30,833 DEBUG [RS:0;jenkins-hbase4:35779] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,833 DEBUG [RS:0;jenkins-hbase4:35779] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,833 DEBUG [RS:0;jenkins-hbase4:35779] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,833 DEBUG [RS:0;jenkins-hbase4:35779] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,833 INFO [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:30,840 INFO [RS:0;jenkins-hbase4:35779] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,840 INFO [RS:1;jenkins-hbase4:42125] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,840 INFO [RS:0;jenkins-hbase4:35779] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,840 INFO [RS:0;jenkins-hbase4:35779] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,840 DEBUG [RS:1;jenkins-hbase4:42125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,840 DEBUG [RS:1;jenkins-hbase4:42125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,840 DEBUG [RS:1;jenkins-hbase4:42125] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,841 DEBUG [RS:1;jenkins-hbase4:42125] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,841 DEBUG [RS:1;jenkins-hbase4:42125] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,841 DEBUG [RS:1;jenkins-hbase4:42125] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:30,841 DEBUG [RS:1;jenkins-hbase4:42125] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,841 DEBUG [RS:1;jenkins-hbase4:42125] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,841 DEBUG [RS:1;jenkins-hbase4:42125] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,841 DEBUG [RS:1;jenkins-hbase4:42125] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:30,844 INFO [RS:1;jenkins-hbase4:42125] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,844 INFO [RS:1;jenkins-hbase4:42125] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,844 INFO [RS:1;jenkins-hbase4:42125] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,857 INFO [RS:0;jenkins-hbase4:35779] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:30,857 INFO [RS:0;jenkins-hbase4:35779] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35779,1676793630471-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,859 INFO [RS:1;jenkins-hbase4:42125] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:30,859 INFO [RS:1;jenkins-hbase4:42125] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42125,1676793630507-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:30,867 DEBUG [jenkins-hbase4:40515] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 08:00:30,867 DEBUG [jenkins-hbase4:40515] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:30,868 DEBUG [jenkins-hbase4:40515] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:30,868 DEBUG [jenkins-hbase4:40515] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:30,868 DEBUG [jenkins-hbase4:40515] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:30,869 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35779,1676793630471, state=OPENING 2023-02-19 08:00:30,870 INFO [RS:0;jenkins-hbase4:35779] regionserver.Replication(203): jenkins-hbase4.apache.org,35779,1676793630471 started 2023-02-19 08:00:30,870 INFO [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35779,1676793630471, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35779, sessionid=0x1006b9838770001 2023-02-19 08:00:30,870 DEBUG [RS:0;jenkins-hbase4:35779] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:30,870 DEBUG [RS:0;jenkins-hbase4:35779] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:30,870 DEBUG [RS:0;jenkins-hbase4:35779] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35779,1676793630471' 2023-02-19 08:00:30,870 DEBUG [RS:0;jenkins-hbase4:35779] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:30,872 DEBUG [RS:0;jenkins-hbase4:35779] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:30,872 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 08:00:30,872 DEBUG [RS:0;jenkins-hbase4:35779] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:30,872 DEBUG [RS:0;jenkins-hbase4:35779] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:30,872 DEBUG [RS:0;jenkins-hbase4:35779] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:30,872 DEBUG [RS:0;jenkins-hbase4:35779] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35779,1676793630471' 2023-02-19 08:00:30,872 DEBUG [RS:0;jenkins-hbase4:35779] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:30,874 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:30,874 DEBUG [RS:0;jenkins-hbase4:35779] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:30,874 DEBUG [RS:0;jenkins-hbase4:35779] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:30,874 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:30,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35779,1676793630471}] 2023-02-19 08:00:30,874 INFO [RS:0;jenkins-hbase4:35779] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:30,874 INFO [RS:0;jenkins-hbase4:35779] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:30,877 INFO [RS:1;jenkins-hbase4:42125] regionserver.Replication(203): jenkins-hbase4.apache.org,42125,1676793630507 started 2023-02-19 08:00:30,877 INFO [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42125,1676793630507, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42125, sessionid=0x1006b9838770002 2023-02-19 08:00:30,877 DEBUG [RS:1;jenkins-hbase4:42125] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:30,877 DEBUG [RS:1;jenkins-hbase4:42125] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:30,877 DEBUG [RS:1;jenkins-hbase4:42125] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42125,1676793630507' 2023-02-19 08:00:30,877 DEBUG [RS:1;jenkins-hbase4:42125] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:30,877 DEBUG [RS:1;jenkins-hbase4:42125] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:30,878 DEBUG [RS:1;jenkins-hbase4:42125] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:30,878 DEBUG [RS:1;jenkins-hbase4:42125] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:30,878 DEBUG [RS:1;jenkins-hbase4:42125] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:30,878 DEBUG [RS:1;jenkins-hbase4:42125] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42125,1676793630507' 2023-02-19 08:00:30,878 DEBUG [RS:1;jenkins-hbase4:42125] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:30,878 DEBUG [RS:1;jenkins-hbase4:42125] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:30,879 DEBUG [RS:1;jenkins-hbase4:42125] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:30,879 INFO [RS:1;jenkins-hbase4:42125] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:30,879 INFO [RS:1;jenkins-hbase4:42125] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:31,029 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:31,029 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:31,031 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42268, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:31,037 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 08:00:31,037 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:31,040 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35779%2C1676793630471.meta, suffix=.meta, logDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/WALs/jenkins-hbase4.apache.org,35779,1676793630471, archiveDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/oldWALs, maxLogs=32 2023-02-19 08:00:31,057 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45871,DS-ba0244cf-9731-4c1e-97dd-b19d4465cb3f,DISK] 2023-02-19 08:00:31,057 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45823,DS-9ed621e7-059c-4181-9c75-dca20f2c6aa1,DISK] 2023-02-19 08:00:31,061 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/WALs/jenkins-hbase4.apache.org,35779,1676793630471/jenkins-hbase4.apache.org%2C35779%2C1676793630471.meta.1676793631041.meta 2023-02-19 08:00:31,061 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45871,DS-ba0244cf-9731-4c1e-97dd-b19d4465cb3f,DISK], DatanodeInfoWithStorage[127.0.0.1:45823,DS-9ed621e7-059c-4181-9c75-dca20f2c6aa1,DISK]] 2023-02-19 08:00:31,061 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:31,061 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 08:00:31,062 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 08:00:31,062 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 08:00:31,062 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 08:00:31,062 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:31,062 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 08:00:31,062 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 08:00:31,068 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:31,069 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/info 2023-02-19 08:00:31,069 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/info 2023-02-19 08:00:31,070 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:31,071 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:31,071 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:31,072 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:31,072 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:31,072 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:31,073 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:31,073 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:31,074 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/table 2023-02-19 08:00:31,074 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/table 2023-02-19 08:00:31,074 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:31,075 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:31,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740 2023-02-19 08:00:31,077 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740 2023-02-19 08:00:31,080 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:31,081 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:31,082 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68752341, jitterRate=0.024489715695381165}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:31,082 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:31,083 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676793631029 2023-02-19 08:00:31,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 08:00:31,091 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 08:00:31,092 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35779,1676793630471, state=OPEN 2023-02-19 08:00:31,093 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 08:00:31,094 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:31,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 08:00:31,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35779,1676793630471 in 220 msec 2023-02-19 08:00:31,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 08:00:31,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 383 msec 2023-02-19 08:00:31,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 419 msec 2023-02-19 08:00:31,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676793631098, completionTime=-1 2023-02-19 08:00:31,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 08:00:31,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 08:00:31,102 DEBUG [hconnection-0x6dbf0d90-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:31,104 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42276, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:31,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 08:00:31,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676793691106 2023-02-19 08:00:31,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676793751106 2023-02-19 08:00:31,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-19 08:00:31,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40515,1676793630408-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:31,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40515,1676793630408-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:31,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40515,1676793630408-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:31,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40515, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:31,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:31,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 08:00:31,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:31,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 08:00:31,115 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 08:00:31,115 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:31,116 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:31,118 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:31,118 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb empty. 2023-02-19 08:00:31,118 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:31,119 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 08:00:31,130 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:31,131 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 48ded158404feef33aaf6a150b6a36cb, NAME => 'hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp 2023-02-19 08:00:31,140 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:31,140 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 48ded158404feef33aaf6a150b6a36cb, disabling compactions & flushes 2023-02-19 08:00:31,141 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:31,141 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:31,141 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. after waiting 0 ms 2023-02-19 08:00:31,141 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:31,141 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:31,141 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 48ded158404feef33aaf6a150b6a36cb: 2023-02-19 08:00:31,142 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:31,143 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793631143"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793631143"}]},"ts":"1676793631143"} 2023-02-19 08:00:31,145 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:31,146 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:31,146 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793631146"}]},"ts":"1676793631146"} 2023-02-19 08:00:31,147 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 08:00:31,150 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:31,151 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:31,151 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:31,151 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:31,151 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=48ded158404feef33aaf6a150b6a36cb, ASSIGN}] 2023-02-19 08:00:31,153 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=48ded158404feef33aaf6a150b6a36cb, ASSIGN 2023-02-19 08:00:31,154 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=48ded158404feef33aaf6a150b6a36cb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42125,1676793630507; forceNewPlan=false, retain=false 2023-02-19 08:00:31,304 INFO [jenkins-hbase4:40515] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:31,305 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=48ded158404feef33aaf6a150b6a36cb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:31,305 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793631305"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793631305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793631305"}]},"ts":"1676793631305"} 2023-02-19 08:00:31,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 48ded158404feef33aaf6a150b6a36cb, server=jenkins-hbase4.apache.org,42125,1676793630507}] 2023-02-19 08:00:31,465 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:31,466 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:31,467 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42280, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:31,476 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:31,478 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42125%2C1676793630507, suffix=, logDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/WALs/jenkins-hbase4.apache.org,42125,1676793630507, archiveDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/oldWALs, maxLogs=32 2023-02-19 08:00:31,501 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45823,DS-9ed621e7-059c-4181-9c75-dca20f2c6aa1,DISK] 2023-02-19 08:00:31,504 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45871,DS-ba0244cf-9731-4c1e-97dd-b19d4465cb3f,DISK] 2023-02-19 08:00:31,511 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/WALs/jenkins-hbase4.apache.org,42125,1676793630507/jenkins-hbase4.apache.org%2C42125%2C1676793630507.1676793631479 2023-02-19 08:00:31,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45871,DS-ba0244cf-9731-4c1e-97dd-b19d4465cb3f,DISK], DatanodeInfoWithStorage[127.0.0.1:45823,DS-9ed621e7-059c-4181-9c75-dca20f2c6aa1,DISK]] 2023-02-19 08:00:31,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 48ded158404feef33aaf6a150b6a36cb, NAME => 'hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:31,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:31,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:31,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:31,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:31,513 INFO [StoreOpener-48ded158404feef33aaf6a150b6a36cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:31,514 DEBUG [StoreOpener-48ded158404feef33aaf6a150b6a36cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb/info 2023-02-19 08:00:31,514 DEBUG [StoreOpener-48ded158404feef33aaf6a150b6a36cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb/info 2023-02-19 08:00:31,515 INFO [StoreOpener-48ded158404feef33aaf6a150b6a36cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48ded158404feef33aaf6a150b6a36cb columnFamilyName info 2023-02-19 08:00:31,516 INFO [StoreOpener-48ded158404feef33aaf6a150b6a36cb-1] regionserver.HStore(310): Store=48ded158404feef33aaf6a150b6a36cb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:31,517 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:31,518 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:31,520 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:31,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:31,534 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 48ded158404feef33aaf6a150b6a36cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68877449, jitterRate=0.026353970170021057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:31,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 48ded158404feef33aaf6a150b6a36cb: 2023-02-19 08:00:31,535 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb., pid=6, masterSystemTime=1676793631465 2023-02-19 08:00:31,539 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:31,540 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:31,540 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=48ded158404feef33aaf6a150b6a36cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:31,540 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793631540"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793631540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793631540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793631540"}]},"ts":"1676793631540"} 2023-02-19 08:00:31,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 08:00:31,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 48ded158404feef33aaf6a150b6a36cb, server=jenkins-hbase4.apache.org,42125,1676793630507 in 235 msec 2023-02-19 08:00:31,547 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 08:00:31,547 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=48ded158404feef33aaf6a150b6a36cb, ASSIGN in 394 msec 2023-02-19 08:00:31,547 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:31,547 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793631547"}]},"ts":"1676793631547"} 2023-02-19 08:00:31,549 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 08:00:31,553 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:31,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 440 msec 2023-02-19 08:00:31,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 08:00:31,617 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:31,617 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:31,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:31,621 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42288, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:31,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 08:00:31,630 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:31,636 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-19 08:00:31,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 08:00:31,651 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:31,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-19 08:00:31,660 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 08:00:31,662 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 08:00:31,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.123sec 2023-02-19 08:00:31,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 08:00:31,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 08:00:31,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 08:00:31,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40515,1676793630408-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 08:00:31,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40515,1676793630408-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 08:00:31,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 08:00:31,732 DEBUG [Listener at localhost/35513] zookeeper.ReadOnlyZKClient(139): Connect 0x1304afca to 127.0.0.1:64022 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:31,739 DEBUG [Listener at localhost/35513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70fe7a0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:31,741 DEBUG [hconnection-0x3cbc7ec2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:31,743 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42288, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:31,745 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40515,1676793630408 2023-02-19 08:00:31,745 DEBUG [Listener at localhost/35513] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 08:00:31,747 DEBUG [Listener at localhost/35513] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 08:00:31,749 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33364, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 08:00:31,750 INFO [Listener at localhost/35513] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:31,750 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:31,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 08:00:31,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:33364 deadline: 1676793691750, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:31,751 INFO [Listener at localhost/35513] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-19 08:00:31,754 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:31,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:31,758 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:31,759 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-19 08:00:31,759 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:31,762 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:31,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:31,763 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3 empty. 2023-02-19 08:00:31,763 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:31,763 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-19 08:00:31,774 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:31,775 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 290821180f849c7d003b3329cf04e9c3, NAME => 'testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp 2023-02-19 08:00:31,781 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:31,781 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 290821180f849c7d003b3329cf04e9c3, disabling compactions & flushes 2023-02-19 08:00:31,781 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:31,781 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:31,781 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. after waiting 0 ms 2023-02-19 08:00:31,781 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:31,781 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:31,782 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 290821180f849c7d003b3329cf04e9c3: 2023-02-19 08:00:31,783 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:31,784 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676793631784"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793631784"}]},"ts":"1676793631784"} 2023-02-19 08:00:31,786 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:31,786 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:31,787 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793631787"}]},"ts":"1676793631787"} 2023-02-19 08:00:31,788 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-19 08:00:31,793 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:31,793 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:31,793 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:31,793 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:31,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=290821180f849c7d003b3329cf04e9c3, ASSIGN}] 2023-02-19 08:00:31,795 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=290821180f849c7d003b3329cf04e9c3, ASSIGN 2023-02-19 08:00:31,796 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=290821180f849c7d003b3329cf04e9c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42125,1676793630507; forceNewPlan=false, retain=false 2023-02-19 08:00:31,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:31,876 INFO [RS:0;jenkins-hbase4:35779] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35779%2C1676793630471, suffix=, logDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/WALs/jenkins-hbase4.apache.org,35779,1676793630471, archiveDir=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/oldWALs, maxLogs=32 2023-02-19 08:00:31,890 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45871,DS-ba0244cf-9731-4c1e-97dd-b19d4465cb3f,DISK] 2023-02-19 08:00:31,891 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45823,DS-9ed621e7-059c-4181-9c75-dca20f2c6aa1,DISK] 2023-02-19 08:00:31,893 INFO [RS:0;jenkins-hbase4:35779] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/WALs/jenkins-hbase4.apache.org,35779,1676793630471/jenkins-hbase4.apache.org%2C35779%2C1676793630471.1676793631876 2023-02-19 08:00:31,893 DEBUG [RS:0;jenkins-hbase4:35779] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45871,DS-ba0244cf-9731-4c1e-97dd-b19d4465cb3f,DISK], DatanodeInfoWithStorage[127.0.0.1:45823,DS-9ed621e7-059c-4181-9c75-dca20f2c6aa1,DISK]] 2023-02-19 08:00:31,946 INFO [jenkins-hbase4:40515] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:31,948 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=290821180f849c7d003b3329cf04e9c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:31,948 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676793631948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793631948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793631948"}]},"ts":"1676793631948"} 2023-02-19 08:00:31,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 290821180f849c7d003b3329cf04e9c3, server=jenkins-hbase4.apache.org,42125,1676793630507}] 2023-02-19 08:00:32,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:32,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:32,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 290821180f849c7d003b3329cf04e9c3, NAME => 'testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:32,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:32,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:32,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:32,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:32,107 INFO [StoreOpener-290821180f849c7d003b3329cf04e9c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:32,109 DEBUG [StoreOpener-290821180f849c7d003b3329cf04e9c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1 2023-02-19 08:00:32,109 DEBUG [StoreOpener-290821180f849c7d003b3329cf04e9c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1 2023-02-19 08:00:32,109 INFO [StoreOpener-290821180f849c7d003b3329cf04e9c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 290821180f849c7d003b3329cf04e9c3 columnFamilyName f1 2023-02-19 08:00:32,110 INFO [StoreOpener-290821180f849c7d003b3329cf04e9c3-1] regionserver.HStore(310): Store=290821180f849c7d003b3329cf04e9c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:32,110 INFO [StoreOpener-290821180f849c7d003b3329cf04e9c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:32,111 DEBUG [StoreOpener-290821180f849c7d003b3329cf04e9c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2 2023-02-19 08:00:32,111 DEBUG [StoreOpener-290821180f849c7d003b3329cf04e9c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2 2023-02-19 08:00:32,111 INFO [StoreOpener-290821180f849c7d003b3329cf04e9c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 290821180f849c7d003b3329cf04e9c3 columnFamilyName f2 2023-02-19 08:00:32,112 INFO [StoreOpener-290821180f849c7d003b3329cf04e9c3-1] regionserver.HStore(310): Store=290821180f849c7d003b3329cf04e9c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:32,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:32,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:32,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:32,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:32,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:32,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 290821180f849c7d003b3329cf04e9c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69991242, jitterRate=0.04295077919960022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:32,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 290821180f849c7d003b3329cf04e9c3: 2023-02-19 08:00:32,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3., pid=12, masterSystemTime=1676793632102 2023-02-19 08:00:32,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:32,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:32,120 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=290821180f849c7d003b3329cf04e9c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,120 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676793632120"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793632120"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793632120"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793632120"}]},"ts":"1676793632120"} 2023-02-19 08:00:32,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 08:00:32,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 290821180f849c7d003b3329cf04e9c3, server=jenkins-hbase4.apache.org,42125,1676793630507 in 172 msec 2023-02-19 08:00:32,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 08:00:32,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=290821180f849c7d003b3329cf04e9c3, ASSIGN in 329 msec 2023-02-19 08:00:32,125 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:32,125 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793632125"}]},"ts":"1676793632125"} 2023-02-19 08:00:32,126 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-19 08:00:32,128 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:32,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 375 msec 2023-02-19 08:00:32,147 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 08:00:32,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:32,367 INFO [Listener at localhost/35513] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-19 08:00:32,367 DEBUG [Listener at localhost/35513] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-19 08:00:32,367 INFO [Listener at localhost/35513] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:32,369 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-19 08:00:32,370 INFO [Listener at localhost/35513] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:32,370 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-19 08:00:32,370 INFO [Listener at localhost/35513] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 08:00:32,392 DEBUG [hconnection-0x3cbc7ec2-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:32,406 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42290, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:32,419 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42125] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:32,525 INFO [Listener at localhost/35513] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 08:00:32,525 INFO [Listener at localhost/35513] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 08:00:32,527 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-19 08:00:32,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676793632527 (current time:1676793632527). 2023-02-19 08:00:32,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 08:00:32,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] zookeeper.ReadOnlyZKClient(139): Connect 0x603c2cd2 to 127.0.0.1:64022 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:32,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59a9355f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:32,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:32,538 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42302, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:32,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x603c2cd2 to 127.0.0.1:64022 2023-02-19 08:00:32,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:32,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 08:00:32,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-19 08:00:32,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-19 08:00:32,542 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-19 08:00:32,542 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676794232542 2023-02-19 08:00:32,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-19 08:00:32,543 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:32,544 DEBUG [Listener at localhost/35513] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:32,544 DEBUG [Listener at localhost/35513] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 08:00:32,544 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-19 08:00:32,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-19 08:00:32,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-19 08:00:32,546 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-19 08:00:32,546 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676794232546 2023-02-19 08:00:32,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-19 08:00:32,555 INFO [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-19 08:00:32,555 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:32,556 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-19 08:00:32,556 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-19 08:00:32,557 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,557 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-19 08:00:32,558 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,558 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:32,558 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:32,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:32,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:32,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:32,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:32,558 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,558 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:32,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 08:00:32,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 08:00:32,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-19 08:00:32,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-19 08:00:32,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 08:00:32,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 08:00:32,559 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-19 08:00:32,559 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-19 08:00:32,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 08:00:32,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 08:00:32,562 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 08:00:32,562 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:32,562 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 08:00:32,562 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 08:00:32,562 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35779,1676793630471' joining acquired barrier for procedure (foo) in zk 2023-02-19 08:00:32,562 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 08:00:32,562 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:32,563 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 08:00:32,563 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 08:00:32,563 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42125,1676793630507' joining acquired barrier for procedure (foo) in zk 2023-02-19 08:00:32,564 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,565 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,565 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,565 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,565 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:32,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:32,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:32,566 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,566 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:32,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:32,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:32,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42125,1676793630507' joining acquired barrier for procedure 'foo' on coordinator 2023-02-19 08:00:32,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70290912[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:32,568 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-19 08:00:32,568 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,570 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,570 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 08:00:32,570 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 08:00:32,570 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,570 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,35779,1676793630471' in zk 2023-02-19 08:00:32,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,570 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,571 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:32,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,571 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 08:00:32,571 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 08:00:32,571 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 08:00:32,571 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:32,571 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. started... 2023-02-19 08:00:32,572 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 290821180f849c7d003b3329cf04e9c3 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 08:00:32,572 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 08:00:32,572 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:32,572 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 08:00:32,589 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/.tmp/f1/dadbb50cbe834a8b847ae1b8cda08e33 2023-02-19 08:00:32,629 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/.tmp/f2/eb9915c1d88f480c81a7615df75e14c6 2023-02-19 08:00:32,638 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/.tmp/f1/dadbb50cbe834a8b847ae1b8cda08e33 as hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1/dadbb50cbe834a8b847ae1b8cda08e33 2023-02-19 08:00:32,644 DEBUG [Listener at localhost/35513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:32,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-19 08:00:32,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:32,648 DEBUG [Listener at localhost/35513] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 08:00:32,650 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1/dadbb50cbe834a8b847ae1b8cda08e33, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 08:00:32,652 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/.tmp/f2/eb9915c1d88f480c81a7615df75e14c6 as hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2/eb9915c1d88f480c81a7615df75e14c6 2023-02-19 08:00:32,663 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2/eb9915c1d88f480c81a7615df75e14c6, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 08:00:32,664 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 290821180f849c7d003b3329cf04e9c3 in 92ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:32,665 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-19 08:00:32,665 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 290821180f849c7d003b3329cf04e9c3: 2023-02-19 08:00:32,665 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.' region-info for snapshot=foo 2023-02-19 08:00:32,665 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:32,665 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1/dadbb50cbe834a8b847ae1b8cda08e33] hfiles 2023-02-19 08:00:32,665 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1/dadbb50cbe834a8b847ae1b8cda08e33 for snapshot=foo 2023-02-19 08:00:32,665 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2/eb9915c1d88f480c81a7615df75e14c6] hfiles 2023-02-19 08:00:32,666 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2/eb9915c1d88f480c81a7615df75e14c6 for snapshot=foo 2023-02-19 08:00:32,677 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. completed. 2023-02-19 08:00:32,677 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:32,677 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 08:00:32,677 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 08:00:32,677 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,677 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 08:00:32,677 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,42125,1676793630507' in zk 2023-02-19 08:00:32,679 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 08:00:32,679 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:32,679 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,679 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 08:00:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:32,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:32,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:32,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:32,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,42125,1676793630507': 2023-02-19 08:00:32,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42125,1676793630507' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-19 08:00:32,683 INFO [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-19 08:00:32,683 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:32,683 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:32,683 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-19 08:00:32,683 INFO [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 08:00:32,686 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,686 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:32,686 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,686 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,686 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:32,687 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:32,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:32,687 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:32,689 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:32,689 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:32,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:32,695 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:32,695 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:32,695 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:32,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:32,695 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:32,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-19 08:00:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:32,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-19 08:00:32,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:32,695 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:32,695 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:32,695 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 08:00:32,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:32,696 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,696 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 08:00:32,696 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:32,696 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:32,696 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:32,697 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 08:00:32,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:32,697 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 08:00:32,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.hbase-snapshot/.tmp/foo 2023-02-19 08:00:32,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.hbase-snapshot/.tmp/foo to hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.hbase-snapshot/foo 2023-02-19 08:00:32,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-19 08:00:32,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.hbase-snapshot/.tmp/foo 2023-02-19 08:00:32,726 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.hbase-snapshot/.tmp/foo 2023-02-19 08:00:32,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676793632543Consolidate snapshot: foo at 1676793632696 (+153 ms)Loading Region manifests for foo at 1676793632696Writing data manifest for foo at 1676793632699 (+3 ms)Verifying snapshot: foo at 1676793632705 (+6 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676793632726 (+21 ms) 2023-02-19 08:00:32,727 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-19 08:00:32,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 184 msec 2023-02-19 08:00:32,848 DEBUG [Listener at localhost/35513] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:32,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-19 08:00:32,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 08:00:32,850 INFO [Listener at localhost/35513] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 08:00:32,856 INFO [Listener at localhost/35513] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 08:00:32,865 INFO [Listener at localhost/35513] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 08:00:32,918 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42125] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,017 INFO [Listener at localhost/35513] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 08:00:33,023 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 08:00:33,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,025 INFO [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-19 08:00:33,025 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:33,026 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-19 08:00:33,026 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-19 08:00:33,026 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,026 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,027 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,028 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:33,028 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:33,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:33,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:33,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:33,028 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,028 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:33,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:33,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:33,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,029 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,030 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,030 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-19 08:00:33,030 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:33,030 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-19 08:00:33,031 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-19 08:00:33,031 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:33,031 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-19 08:00:33,032 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-19 08:00:33,032 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35779,1676793630471' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-19 08:00:33,032 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 08:00:33,032 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 08:00:33,032 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,032 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. started... 2023-02-19 08:00:33,032 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 290821180f849c7d003b3329cf04e9c3 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 08:00:33,034 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,034 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,034 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:33,051 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/.tmp/f1/57ff77c49088433393385f245bf7b0b2 2023-02-19 08:00:33,069 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/.tmp/f2/aa0a1c2b7b6d436c88aca8cb6cb37146 2023-02-19 08:00:33,073 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/.tmp/f1/57ff77c49088433393385f245bf7b0b2 as hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1/57ff77c49088433393385f245bf7b0b2 2023-02-19 08:00:33,077 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1/57ff77c49088433393385f245bf7b0b2, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 08:00:33,078 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/.tmp/f2/aa0a1c2b7b6d436c88aca8cb6cb37146 as hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2/aa0a1c2b7b6d436c88aca8cb6cb37146 2023-02-19 08:00:33,082 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2/aa0a1c2b7b6d436c88aca8cb6cb37146, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 08:00:33,082 INFO [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 290821180f849c7d003b3329cf04e9c3 in 50ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:33,083 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 290821180f849c7d003b3329cf04e9c3: 2023-02-19 08:00:33,083 DEBUG [rs(jenkins-hbase4.apache.org,42125,1676793630507)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,083 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 08:00:33,083 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 08:00:33,083 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,083 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-19 08:00:33,083 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42125,1676793630507' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-19 08:00:33,085 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,085 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:33,085 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,085 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:33,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42125,1676793630507' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-19 08:00:33,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@741693cf[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:33,087 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-19 08:00:33,087 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,089 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,089 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,089 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-19 08:00:33,089 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-19 08:00:33,089 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-19 08:00:33,089 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,089 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,35779,1676793630471' in zk 2023-02-19 08:00:33,089 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-19 08:00:33,089 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:33,089 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,42125,1676793630507' in zk 2023-02-19 08:00:33,090 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-19 08:00:33,090 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:33,090 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-19 08:00:33,090 DEBUG [member: 'jenkins-hbase4.apache.org,35779,1676793630471' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-19 08:00:33,090 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,090 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:33,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,091 DEBUG [member: 'jenkins-hbase4.apache.org,42125,1676793630507' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-19 08:00:33,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,42125,1676793630507': 2023-02-19 08:00:33,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42125,1676793630507' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-19 08:00:33,094 INFO [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-19 08:00:33,095 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:33,095 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:33,095 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,095 INFO [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 08:00:33,096 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,096 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,096 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:33,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,096 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:33,096 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:33,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:33,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,097 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:33,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:33,097 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:33,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,098 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:33,099 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,101 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:33,101 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,101 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:33,101 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,101 DEBUG [(jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:33,101 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:33,101 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,102 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:33,101 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-19 08:00:33,102 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 08:00:33,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:33,102 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:33,102 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:33,102 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:33,102 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,102 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,102 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,102 DEBUG [Listener at localhost/35513] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:33,102 DEBUG [Listener at localhost/35513] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 08:00:33,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:33,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:33,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:33,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:33,202 DEBUG [Listener at localhost/35513] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 08:00:33,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 08:00:33,209 INFO [Listener at localhost/35513] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676793632527 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:33,209 DEBUG [Listener at localhost/35513] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44751/user/jenkins/test-data/2445e0a5-b96f-9440-da07-1d114feefc44/foo/72bb6a07-8d6c-4743-8c4d-147a761cad2c/data/default/testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,210 INFO [Listener at localhost/35513] snapshot.RestoreSnapshotHelper(239): region to add: 290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:33,210 INFO [Listener at localhost/35513] snapshot.RestoreSnapshotHelper(585): clone region=290821180f849c7d003b3329cf04e9c3 as 290821180f849c7d003b3329cf04e9c3 in snapshot foo 2023-02-19 08:00:33,211 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 290821180f849c7d003b3329cf04e9c3, NAME => 'testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44751/user/jenkins/test-data/2445e0a5-b96f-9440-da07-1d114feefc44/foo/72bb6a07-8d6c-4743-8c4d-147a761cad2c 2023-02-19 08:00:33,221 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:33,221 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dadbb50cbe834a8b847ae1b8cda08e33 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,229 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eb9915c1d88f480c81a7615df75e14c6 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,232 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 290821180f849c7d003b3329cf04e9c3, disabling compactions & flushes 2023-02-19 08:00:33,232 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,232 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,232 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. after waiting 0 ms 2023-02-19 08:00:33,233 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,233 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,233 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 290821180f849c7d003b3329cf04e9c3: 2023-02-19 08:00:33,233 INFO [Listener at localhost/35513] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676793632527 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:33,233 DEBUG [Listener at localhost/35513] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44751/user/jenkins/test-data/2445e0a5-b96f-9440-da07-1d114feefc44/foo/72bb6a07-8d6c-4743-8c4d-147a761cad2c 2023-02-19 08:00:33,233 DEBUG [Listener at localhost/35513] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44751/user/jenkins/test-data/2445e0a5-b96f-9440-da07-1d114feefc44/foo/72bb6a07-8d6c-4743-8c4d-147a761cad2c 2023-02-19 08:00:33,234 DEBUG [Listener at localhost/35513] util.CommonFSUtils(699): |-data/ 2023-02-19 08:00:33,234 DEBUG [Listener at localhost/35513] util.CommonFSUtils(699): |----default/ 2023-02-19 08:00:33,235 DEBUG [Listener at localhost/35513] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-19 08:00:33,236 DEBUG [Listener at localhost/35513] util.CommonFSUtils(699): |----------290821180f849c7d003b3329cf04e9c3/ 2023-02-19 08:00:33,239 DEBUG [Listener at localhost/35513] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:33,239 DEBUG [Listener at localhost/35513] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:33,240 DEBUG [Listener at localhost/35513] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=290821180f849c7d003b3329cf04e9c3-dadbb50cbe834a8b847ae1b8cda08e33 2023-02-19 08:00:33,240 DEBUG [Listener at localhost/35513] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:33,241 DEBUG [Listener at localhost/35513] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=290821180f849c7d003b3329cf04e9c3-eb9915c1d88f480c81a7615df75e14c6 2023-02-19 08:00:33,243 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-19 08:00:33,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-19 08:00:33,247 INFO [Listener at localhost/35513] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,247 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:33,257 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793633257"}]},"ts":"1676793633257"} 2023-02-19 08:00:33,260 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-19 08:00:33,263 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-19 08:00:33,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=290821180f849c7d003b3329cf04e9c3, UNASSIGN}] 2023-02-19 08:00:33,266 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=290821180f849c7d003b3329cf04e9c3, UNASSIGN 2023-02-19 08:00:33,267 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=290821180f849c7d003b3329cf04e9c3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,267 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676793633267"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793633267"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793633267"}]},"ts":"1676793633267"} 2023-02-19 08:00:33,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 290821180f849c7d003b3329cf04e9c3, server=jenkins-hbase4.apache.org,42125,1676793630507}] 2023-02-19 08:00:33,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:33,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:33,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 290821180f849c7d003b3329cf04e9c3, disabling compactions & flushes 2023-02-19 08:00:33,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. after waiting 0 ms 2023-02-19 08:00:33,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:33,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3. 2023-02-19 08:00:33,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 290821180f849c7d003b3329cf04e9c3: 2023-02-19 08:00:33,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:33,430 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=290821180f849c7d003b3329cf04e9c3, regionState=CLOSED 2023-02-19 08:00:33,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676793633430"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793633430"}]},"ts":"1676793633430"} 2023-02-19 08:00:33,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 08:00:33,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 290821180f849c7d003b3329cf04e9c3, server=jenkins-hbase4.apache.org,42125,1676793630507 in 162 msec 2023-02-19 08:00:33,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 08:00:33,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=290821180f849c7d003b3329cf04e9c3, UNASSIGN in 169 msec 2023-02-19 08:00:33,434 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793633434"}]},"ts":"1676793633434"} 2023-02-19 08:00:33,436 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-19 08:00:33,437 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-19 08:00:33,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 191 msec 2023-02-19 08:00:33,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:33,556 INFO [Listener at localhost/35513] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-19 08:00:33,557 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,560 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,561 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 08:00:33,565 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:33,568 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1, FileablePath, hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2, FileablePath, hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/recovered.edits] 2023-02-19 08:00:33,574 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1/57ff77c49088433393385f245bf7b0b2 to hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/archive/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1/57ff77c49088433393385f245bf7b0b2 2023-02-19 08:00:33,576 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1/dadbb50cbe834a8b847ae1b8cda08e33 to hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/archive/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f1/dadbb50cbe834a8b847ae1b8cda08e33 2023-02-19 08:00:33,579 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2/aa0a1c2b7b6d436c88aca8cb6cb37146 to hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/archive/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2/aa0a1c2b7b6d436c88aca8cb6cb37146 2023-02-19 08:00:33,581 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2/eb9915c1d88f480c81a7615df75e14c6 to hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/archive/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/f2/eb9915c1d88f480c81a7615df75e14c6 2023-02-19 08:00:33,583 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/recovered.edits/12.seqid to hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/archive/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3/recovered.edits/12.seqid 2023-02-19 08:00:33,584 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/290821180f849c7d003b3329cf04e9c3 2023-02-19 08:00:33,584 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-19 08:00:33,586 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,588 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-19 08:00:33,590 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-19 08:00:33,591 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,591 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-19 08:00:33,591 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793633591"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:33,592 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 08:00:33,592 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 290821180f849c7d003b3329cf04e9c3, NAME => 'testInitTableSnapshotMapperJobConfig,,1676793631754.290821180f849c7d003b3329cf04e9c3.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 08:00:33,592 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-19 08:00:33,592 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676793633592"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:33,596 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-19 08:00:33,598 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-19 08:00:33,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 41 msec 2023-02-19 08:00:33,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40515] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 08:00:33,663 INFO [Listener at localhost/35513] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-19 08:00:33,663 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 08:00:33,663 INFO [Listener at localhost/35513] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 08:00:33,663 DEBUG [Listener at localhost/35513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1304afca to 127.0.0.1:64022 2023-02-19 08:00:33,663 DEBUG [Listener at localhost/35513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:33,664 DEBUG [Listener at localhost/35513] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 08:00:33,664 DEBUG [Listener at localhost/35513] util.JVMClusterUtil(257): Found active master hash=569191894, stopped=false 2023-02-19 08:00:33,664 INFO [Listener at localhost/35513] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40515,1676793630408 2023-02-19 08:00:33,665 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:33,665 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:33,665 INFO [Listener at localhost/35513] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 08:00:33,665 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:33,665 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:33,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:33,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:33,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:33,666 DEBUG [Listener at localhost/35513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f827c8e to 127.0.0.1:64022 2023-02-19 08:00:33,667 DEBUG [Listener at localhost/35513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:33,667 INFO [Listener at localhost/35513] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35779,1676793630471' ***** 2023-02-19 08:00:33,668 INFO [Listener at localhost/35513] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:33,668 INFO [Listener at localhost/35513] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42125,1676793630507' ***** 2023-02-19 08:00:33,668 INFO [Listener at localhost/35513] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:33,668 INFO [RS:0;jenkins-hbase4:35779] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:33,668 INFO [RS:1;jenkins-hbase4:42125] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:33,668 INFO [RS:0;jenkins-hbase4:35779] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:33,668 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:33,669 INFO [RS:0;jenkins-hbase4:35779] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:33,668 INFO [RS:1;jenkins-hbase4:42125] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:33,668 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:33,669 INFO [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,669 INFO [RS:1;jenkins-hbase4:42125] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:33,671 INFO [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(3304): Received CLOSE for 48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:33,670 DEBUG [RS:0;jenkins-hbase4:35779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e6a1ade to 127.0.0.1:64022 2023-02-19 08:00:33,672 DEBUG [RS:0;jenkins-hbase4:35779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:33,673 INFO [RS:0;jenkins-hbase4:35779] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:33,673 INFO [RS:0;jenkins-hbase4:35779] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:33,673 INFO [RS:0;jenkins-hbase4:35779] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:33,673 INFO [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 08:00:33,672 INFO [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,673 DEBUG [RS:1;jenkins-hbase4:42125] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20cdf4b4 to 127.0.0.1:64022 2023-02-19 08:00:33,673 DEBUG [RS:1;jenkins-hbase4:42125] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:33,673 INFO [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 08:00:33,673 DEBUG [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1479): Online Regions={48ded158404feef33aaf6a150b6a36cb=hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb.} 2023-02-19 08:00:33,673 DEBUG [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1505): Waiting on 48ded158404feef33aaf6a150b6a36cb 2023-02-19 08:00:33,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 48ded158404feef33aaf6a150b6a36cb, disabling compactions & flushes 2023-02-19 08:00:33,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:33,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:33,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. after waiting 0 ms 2023-02-19 08:00:33,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:33,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 48ded158404feef33aaf6a150b6a36cb 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 08:00:33,676 INFO [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 08:00:33,676 DEBUG [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-19 08:00:33,676 DEBUG [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 08:00:33,677 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:33,677 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:33,677 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:33,677 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:33,677 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:33,677 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-19 08:00:33,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/.tmp/info/cef99c0b63dc43479108264800289ba3 2023-02-19 08:00:33,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb/.tmp/info/7c16f7254ecf474bb2e5356b2ae1e21c 2023-02-19 08:00:33,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cef99c0b63dc43479108264800289ba3 2023-02-19 08:00:33,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb/.tmp/info/7c16f7254ecf474bb2e5356b2ae1e21c as hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb/info/7c16f7254ecf474bb2e5356b2ae1e21c 2023-02-19 08:00:33,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb/info/7c16f7254ecf474bb2e5356b2ae1e21c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 08:00:33,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 48ded158404feef33aaf6a150b6a36cb in 37ms, sequenceid=6, compaction requested=false 2023-02-19 08:00:33,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-19 08:00:33,714 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/.tmp/rep_barrier/9eb8c3082bdb495db5b1519776bdcc62 2023-02-19 08:00:33,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/namespace/48ded158404feef33aaf6a150b6a36cb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 08:00:33,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:33,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 48ded158404feef33aaf6a150b6a36cb: 2023-02-19 08:00:33,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676793631113.48ded158404feef33aaf6a150b6a36cb. 2023-02-19 08:00:33,719 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9eb8c3082bdb495db5b1519776bdcc62 2023-02-19 08:00:33,726 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/.tmp/table/b5c4b9ba3b034565908251c76e5bb16f 2023-02-19 08:00:33,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5c4b9ba3b034565908251c76e5bb16f 2023-02-19 08:00:33,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/.tmp/info/cef99c0b63dc43479108264800289ba3 as hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/info/cef99c0b63dc43479108264800289ba3 2023-02-19 08:00:33,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cef99c0b63dc43479108264800289ba3 2023-02-19 08:00:33,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/info/cef99c0b63dc43479108264800289ba3, entries=12, sequenceid=21, filesize=6.3 K 2023-02-19 08:00:33,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/.tmp/rep_barrier/9eb8c3082bdb495db5b1519776bdcc62 as hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/rep_barrier/9eb8c3082bdb495db5b1519776bdcc62 2023-02-19 08:00:33,740 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9eb8c3082bdb495db5b1519776bdcc62 2023-02-19 08:00:33,740 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/rep_barrier/9eb8c3082bdb495db5b1519776bdcc62, entries=1, sequenceid=21, filesize=5.0 K 2023-02-19 08:00:33,740 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/.tmp/table/b5c4b9ba3b034565908251c76e5bb16f as hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/table/b5c4b9ba3b034565908251c76e5bb16f 2023-02-19 08:00:33,743 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:33,745 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5c4b9ba3b034565908251c76e5bb16f 2023-02-19 08:00:33,746 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/table/b5c4b9ba3b034565908251c76e5bb16f, entries=4, sequenceid=21, filesize=5.1 K 2023-02-19 08:00:33,747 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 70ms, sequenceid=21, compaction requested=false 2023-02-19 08:00:33,747 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:33,752 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 08:00:33,752 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 08:00:33,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:33,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:33,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:33,844 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 08:00:33,844 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 08:00:33,854 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 08:00:33,854 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 08:00:33,874 INFO [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42125,1676793630507; all regions closed. 2023-02-19 08:00:33,877 INFO [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35779,1676793630471; all regions closed. 2023-02-19 08:00:33,882 DEBUG [RS:1;jenkins-hbase4:42125] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/oldWALs 2023-02-19 08:00:33,882 INFO [RS:1;jenkins-hbase4:42125] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42125%2C1676793630507:(num 1676793631479) 2023-02-19 08:00:33,882 DEBUG [RS:1;jenkins-hbase4:42125] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:33,882 INFO [RS:1;jenkins-hbase4:42125] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:33,883 INFO [RS:1;jenkins-hbase4:42125] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:33,883 INFO [RS:1;jenkins-hbase4:42125] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:33,883 INFO [RS:1;jenkins-hbase4:42125] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:33,883 INFO [RS:1;jenkins-hbase4:42125] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:33,884 INFO [RS:1;jenkins-hbase4:42125] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42125 2023-02-19 08:00:33,886 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:33,886 DEBUG [RS:0;jenkins-hbase4:35779] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/oldWALs 2023-02-19 08:00:33,886 INFO [RS:0;jenkins-hbase4:35779] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35779%2C1676793630471.meta:.meta(num 1676793631041) 2023-02-19 08:00:33,887 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,887 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:33,887 ERROR [Listener at localhost/35513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55a0e2ef rejected from java.util.concurrent.ThreadPoolExecutor@519f6c83[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:33,887 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:33,888 ERROR [Listener at localhost/35513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@77262d2b rejected from java.util.concurrent.ThreadPoolExecutor@519f6c83[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:33,888 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42125,1676793630507 2023-02-19 08:00:33,888 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:33,890 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42125,1676793630507] 2023-02-19 08:00:33,891 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42125,1676793630507; numProcessing=1 2023-02-19 08:00:33,893 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42125,1676793630507 already deleted, retry=false 2023-02-19 08:00:33,893 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42125,1676793630507 expired; onlineServers=1 2023-02-19 08:00:33,893 DEBUG [RS:0;jenkins-hbase4:35779] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/oldWALs 2023-02-19 08:00:33,893 INFO [RS:0;jenkins-hbase4:35779] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35779%2C1676793630471:(num 1676793631876) 2023-02-19 08:00:33,893 DEBUG [RS:0;jenkins-hbase4:35779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:33,894 INFO [RS:0;jenkins-hbase4:35779] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:33,894 INFO [RS:0;jenkins-hbase4:35779] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:33,894 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:33,901 INFO [RS:0;jenkins-hbase4:35779] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35779 2023-02-19 08:00:33,902 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:33,902 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35779,1676793630471 2023-02-19 08:00:33,903 ERROR [Listener at localhost/35513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@65fef09e rejected from java.util.concurrent.ThreadPoolExecutor@61c168f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:33,905 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35779,1676793630471] 2023-02-19 08:00:33,905 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35779,1676793630471; numProcessing=2 2023-02-19 08:00:33,906 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35779,1676793630471 already deleted, retry=false 2023-02-19 08:00:33,906 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35779,1676793630471 expired; onlineServers=0 2023-02-19 08:00:33,906 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40515,1676793630408' ***** 2023-02-19 08:00:33,906 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 08:00:33,907 DEBUG [M:0;jenkins-hbase4:40515] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25d2bd33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:33,907 INFO [M:0;jenkins-hbase4:40515] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40515,1676793630408 2023-02-19 08:00:33,907 INFO [M:0;jenkins-hbase4:40515] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40515,1676793630408; all regions closed. 2023-02-19 08:00:33,907 DEBUG [M:0;jenkins-hbase4:40515] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:33,908 DEBUG [M:0;jenkins-hbase4:40515] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 08:00:33,908 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 08:00:33,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793630684] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793630684,5,FailOnTimeoutGroup] 2023-02-19 08:00:33,908 DEBUG [M:0;jenkins-hbase4:40515] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 08:00:33,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793630685] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793630685,5,FailOnTimeoutGroup] 2023-02-19 08:00:33,909 INFO [M:0;jenkins-hbase4:40515] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 08:00:33,910 INFO [M:0;jenkins-hbase4:40515] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 08:00:33,910 INFO [M:0;jenkins-hbase4:40515] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 08:00:33,910 DEBUG [M:0;jenkins-hbase4:40515] master.HMaster(1512): Stopping service threads 2023-02-19 08:00:33,910 INFO [M:0;jenkins-hbase4:40515] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 08:00:33,910 ERROR [M:0;jenkins-hbase4:40515] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 08:00:33,910 INFO [M:0;jenkins-hbase4:40515] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 08:00:33,911 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 08:00:33,911 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:33,911 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:33,911 DEBUG [M:0;jenkins-hbase4:40515] zookeeper.ZKUtil(398): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 08:00:33,911 WARN [M:0;jenkins-hbase4:40515] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 08:00:33,911 INFO [M:0;jenkins-hbase4:40515] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 08:00:33,912 INFO [M:0;jenkins-hbase4:40515] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 08:00:33,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:33,913 DEBUG [M:0;jenkins-hbase4:40515] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:33,913 INFO [M:0;jenkins-hbase4:40515] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:33,913 DEBUG [M:0;jenkins-hbase4:40515] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:33,913 DEBUG [M:0;jenkins-hbase4:40515] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:33,913 DEBUG [M:0;jenkins-hbase4:40515] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:33,913 INFO [M:0;jenkins-hbase4:40515] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.88 KB heapSize=66.81 KB 2023-02-19 08:00:33,923 INFO [M:0;jenkins-hbase4:40515] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.88 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9f1c2acc632b427087b33213c6332c69 2023-02-19 08:00:33,928 DEBUG [M:0;jenkins-hbase4:40515] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9f1c2acc632b427087b33213c6332c69 as hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9f1c2acc632b427087b33213c6332c69 2023-02-19 08:00:33,934 INFO [M:0;jenkins-hbase4:40515] regionserver.HStore(1080): Added hdfs://localhost:44751/user/jenkins/test-data/c95885ac-3492-2582-74bb-11ae0e69a5f0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9f1c2acc632b427087b33213c6332c69, entries=17, sequenceid=132, filesize=8.7 K 2023-02-19 08:00:33,935 INFO [M:0;jenkins-hbase4:40515] regionserver.HRegion(2947): Finished flush of dataSize ~55.88 KB/57220, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=132, compaction requested=false 2023-02-19 08:00:33,935 INFO [M:0;jenkins-hbase4:40515] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:33,935 DEBUG [M:0;jenkins-hbase4:40515] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:33,941 INFO [M:0;jenkins-hbase4:40515] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 08:00:33,941 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:33,942 INFO [M:0;jenkins-hbase4:40515] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40515 2023-02-19 08:00:33,944 DEBUG [M:0;jenkins-hbase4:40515] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40515,1676793630408 already deleted, retry=false 2023-02-19 08:00:34,066 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:34,066 INFO [M:0;jenkins-hbase4:40515] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40515,1676793630408; zookeeper connection closed. 2023-02-19 08:00:34,066 ERROR [Listener at localhost/35513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30b70801 rejected from java.util.concurrent.ThreadPoolExecutor@34889acf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:34,067 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): master:40515-0x1006b9838770000, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:34,067 ERROR [Listener at localhost/35513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48cee8bd rejected from java.util.concurrent.ThreadPoolExecutor@34889acf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:34,166 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:34,166 INFO [RS:0;jenkins-hbase4:35779] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35779,1676793630471; zookeeper connection closed. 2023-02-19 08:00:34,166 ERROR [Listener at localhost/35513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74580ff rejected from java.util.concurrent.ThreadPoolExecutor@61c168f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:34,166 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@44816fbf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@44816fbf 2023-02-19 08:00:34,166 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:35779-0x1006b9838770001, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:34,166 ERROR [Listener at localhost/35513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f41de75 rejected from java.util.concurrent.ThreadPoolExecutor@61c168f9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:34,266 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:34,266 INFO [RS:1;jenkins-hbase4:42125] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42125,1676793630507; zookeeper connection closed. 2023-02-19 08:00:34,266 ERROR [Listener at localhost/35513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f9285f5 rejected from java.util.concurrent.ThreadPoolExecutor@519f6c83[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:34,266 DEBUG [Listener at localhost/35513-EventThread] zookeeper.ZKWatcher(600): regionserver:42125-0x1006b9838770002, quorum=127.0.0.1:64022, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:34,266 ERROR [Listener at localhost/35513-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@323b3353 rejected from java.util.concurrent.ThreadPoolExecutor@519f6c83[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:34,266 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@c116615] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@c116615 2023-02-19 08:00:34,267 INFO [Listener at localhost/35513] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 08:00:34,267 WARN [Listener at localhost/35513] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:34,271 INFO [Listener at localhost/35513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:34,374 WARN [BP-421898070-172.31.14.131-1676793629748 heartbeating to localhost/127.0.0.1:44751] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:34,374 WARN [BP-421898070-172.31.14.131-1676793629748 heartbeating to localhost/127.0.0.1:44751] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-421898070-172.31.14.131-1676793629748 (Datanode Uuid 6cb33856-b7a0-4bfa-8a3a-a322c4cb445e) service to localhost/127.0.0.1:44751 2023-02-19 08:00:34,377 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/cluster_3412e0af-2a47-9c62-bf1d-3572be45fe3d/dfs/data/data3/current/BP-421898070-172.31.14.131-1676793629748] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:34,378 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/cluster_3412e0af-2a47-9c62-bf1d-3572be45fe3d/dfs/data/data4/current/BP-421898070-172.31.14.131-1676793629748] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:34,381 WARN [Listener at localhost/35513] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:34,390 INFO [Listener at localhost/35513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:34,496 WARN [BP-421898070-172.31.14.131-1676793629748 heartbeating to localhost/127.0.0.1:44751] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:34,496 WARN [BP-421898070-172.31.14.131-1676793629748 heartbeating to localhost/127.0.0.1:44751] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-421898070-172.31.14.131-1676793629748 (Datanode Uuid a91802e6-d4c8-410a-be9b-2462da7ae464) service to localhost/127.0.0.1:44751 2023-02-19 08:00:34,496 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/cluster_3412e0af-2a47-9c62-bf1d-3572be45fe3d/dfs/data/data1/current/BP-421898070-172.31.14.131-1676793629748] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:34,497 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/cluster_3412e0af-2a47-9c62-bf1d-3572be45fe3d/dfs/data/data2/current/BP-421898070-172.31.14.131-1676793629748] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:34,509 INFO [Listener at localhost/35513] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:34,625 INFO [Listener at localhost/35513] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 08:00:34,657 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 08:00:34,673 INFO [Listener at localhost/35513] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=179 (was 154) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:44751 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:44751 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35513 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:44751 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44751 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:44751 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40515,1676793630408)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:44751 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:44751 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=568 (was 534) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=405 (was 405), ProcessCount=170 (was 170), AvailableMemoryMB=9316 (was 9453) 2023-02-19 08:00:34,684 INFO [Listener at localhost/35513] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=179, OpenFileDescriptor=568, MaxFileDescriptor=60000, SystemLoadAverage=405, ProcessCount=170, AvailableMemoryMB=9315 2023-02-19 08:00:34,694 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/hadoop.log.dir so I do NOT create it in target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a 2023-02-19 08:00:34,694 WARN [Listener at localhost/35513] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 08:00:34,694 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/hadoop.tmp.dir so I do NOT create it in target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a 2023-02-19 08:00:34,694 WARN [Listener at localhost/35513] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0cf9cc87-58c9-de16-fcf3-4db11765eff7/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 08:00:34,694 DEBUG [Listener at localhost/35513] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a 2023-02-19 08:00:34,695 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 08:00:34,695 INFO [Listener at localhost/35513] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/cluster_5ddcc1d0-a92e-5449-56a2-fdc1296d720b, deleteOnExit=true 2023-02-19 08:00:34,695 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 08:00:34,695 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/test.cache.data in system properties and HBase conf 2023-02-19 08:00:34,695 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 08:00:34,695 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/hadoop.log.dir in system properties and HBase conf 2023-02-19 08:00:34,695 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 08:00:34,695 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 08:00:34,695 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 08:00:34,695 DEBUG [Listener at localhost/35513] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 08:00:34,696 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:34,696 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:34,696 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 08:00:34,696 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:34,696 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 08:00:34,696 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 08:00:34,696 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:34,696 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:34,696 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 08:00:34,696 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/nfs.dump.dir in system properties and HBase conf 2023-02-19 08:00:34,697 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/java.io.tmpdir in system properties and HBase conf 2023-02-19 08:00:34,697 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:34,697 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 08:00:34,697 INFO [Listener at localhost/35513] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 08:00:34,701 WARN [Listener at localhost/35513] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:34,701 WARN [Listener at localhost/35513] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:34,746 WARN [Listener at localhost/35513] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:34,748 INFO [Listener at localhost/35513] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:34,754 INFO [Listener at localhost/35513] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/java.io.tmpdir/Jetty_localhost_46133_hdfs____.r0893/webapp 2023-02-19 08:00:34,828 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 08:00:34,857 INFO [Listener at localhost/35513] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46133 2023-02-19 08:00:34,861 WARN [Listener at localhost/35513] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:34,861 WARN [Listener at localhost/35513] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:34,906 WARN [Listener at localhost/40365] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:34,918 WARN [Listener at localhost/40365] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:34,921 WARN [Listener at localhost/40365] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:34,922 INFO [Listener at localhost/40365] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:34,926 INFO [Listener at localhost/40365] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/java.io.tmpdir/Jetty_localhost_45715_datanode____.t8idnj/webapp 2023-02-19 08:00:35,022 INFO [Listener at localhost/40365] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45715 2023-02-19 08:00:35,034 WARN [Listener at localhost/36315] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:35,049 WARN [Listener at localhost/36315] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:35,051 WARN [Listener at localhost/36315] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:35,052 INFO [Listener at localhost/36315] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:35,057 INFO [Listener at localhost/36315] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/java.io.tmpdir/Jetty_localhost_43563_datanode____.na7idi/webapp 2023-02-19 08:00:35,134 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3653c0a3b138cfc9: Processing first storage report for DS-9536f868-7b4b-4a1e-96f0-c1676bfcd5e8 from datanode 3f33c371-7cf1-46a9-aecf-464c97df7335 2023-02-19 08:00:35,134 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3653c0a3b138cfc9: from storage DS-9536f868-7b4b-4a1e-96f0-c1676bfcd5e8 node DatanodeRegistration(127.0.0.1:35303, datanodeUuid=3f33c371-7cf1-46a9-aecf-464c97df7335, infoPort=35587, infoSecurePort=0, ipcPort=36315, storageInfo=lv=-57;cid=testClusterID;nsid=237864976;c=1676793634703), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:35,134 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3653c0a3b138cfc9: Processing first storage report for DS-4b1ce221-cafe-41dd-a25f-dfb69dd07ced from datanode 3f33c371-7cf1-46a9-aecf-464c97df7335 2023-02-19 08:00:35,134 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3653c0a3b138cfc9: from storage DS-4b1ce221-cafe-41dd-a25f-dfb69dd07ced node DatanodeRegistration(127.0.0.1:35303, datanodeUuid=3f33c371-7cf1-46a9-aecf-464c97df7335, infoPort=35587, infoSecurePort=0, ipcPort=36315, storageInfo=lv=-57;cid=testClusterID;nsid=237864976;c=1676793634703), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:35,159 INFO [Listener at localhost/36315] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43563 2023-02-19 08:00:35,167 WARN [Listener at localhost/41563] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:35,265 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4755df384fb1e69: Processing first storage report for DS-1b1bc6a8-0dc2-4d91-9eb3-c97b7f18108e from datanode 304de51b-e568-4e2b-a7fd-37c4a24344b5 2023-02-19 08:00:35,265 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4755df384fb1e69: from storage DS-1b1bc6a8-0dc2-4d91-9eb3-c97b7f18108e node DatanodeRegistration(127.0.0.1:34595, datanodeUuid=304de51b-e568-4e2b-a7fd-37c4a24344b5, infoPort=45571, infoSecurePort=0, ipcPort=41563, storageInfo=lv=-57;cid=testClusterID;nsid=237864976;c=1676793634703), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:35,266 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4755df384fb1e69: Processing first storage report for DS-b801dc68-d1c8-460c-bc33-71f8d5fdbcc5 from datanode 304de51b-e568-4e2b-a7fd-37c4a24344b5 2023-02-19 08:00:35,266 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4755df384fb1e69: from storage DS-b801dc68-d1c8-460c-bc33-71f8d5fdbcc5 node DatanodeRegistration(127.0.0.1:34595, datanodeUuid=304de51b-e568-4e2b-a7fd-37c4a24344b5, infoPort=45571, infoSecurePort=0, ipcPort=41563, storageInfo=lv=-57;cid=testClusterID;nsid=237864976;c=1676793634703), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:35,273 DEBUG [Listener at localhost/41563] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a 2023-02-19 08:00:35,275 INFO [Listener at localhost/41563] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/cluster_5ddcc1d0-a92e-5449-56a2-fdc1296d720b/zookeeper_0, clientPort=57105, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/cluster_5ddcc1d0-a92e-5449-56a2-fdc1296d720b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/cluster_5ddcc1d0-a92e-5449-56a2-fdc1296d720b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 08:00:35,276 INFO [Listener at localhost/41563] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57105 2023-02-19 08:00:35,276 INFO [Listener at localhost/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,277 INFO [Listener at localhost/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,295 INFO [Listener at localhost/41563] util.FSUtils(479): Created version file at hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e with version=8 2023-02-19 08:00:35,296 INFO [Listener at localhost/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,297 INFO [Listener at localhost/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,298 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/hbase-staging 2023-02-19 08:00:35,299 INFO [Listener at localhost/41563] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:35,299 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:35,299 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:35,300 INFO [Listener at localhost/41563] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:35,300 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:35,300 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:35,300 INFO [Listener at localhost/41563] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:35,301 INFO [Listener at localhost/41563] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39791 2023-02-19 08:00:35,301 INFO [Listener at localhost/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,302 INFO [Listener at localhost/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,302 INFO [Listener at localhost/41563] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39791 connecting to ZooKeeper ensemble=127.0.0.1:57105 2023-02-19 08:00:35,313 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:397910x0, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:35,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39791-0x1006b984b8f0000 connected 2023-02-19 08:00:35,679 DEBUG [Listener at localhost/41563] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:35,680 DEBUG [Listener at localhost/41563] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:35,680 DEBUG [Listener at localhost/41563] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:35,681 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39791 2023-02-19 08:00:35,681 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39791 2023-02-19 08:00:35,681 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39791 2023-02-19 08:00:35,681 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39791 2023-02-19 08:00:35,682 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39791 2023-02-19 08:00:35,682 INFO [Listener at localhost/41563] master.HMaster(444): hbase.rootdir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e, hbase.cluster.distributed=false 2023-02-19 08:00:35,699 INFO [Listener at localhost/41563] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:35,699 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:35,699 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:35,699 INFO [Listener at localhost/41563] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:35,699 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:35,699 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:35,700 INFO [Listener at localhost/41563] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:35,704 INFO [Listener at localhost/41563] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34119 2023-02-19 08:00:35,705 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:35,717 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:35,717 INFO [Listener at localhost/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,719 INFO [Listener at localhost/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,720 INFO [Listener at localhost/41563] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34119 connecting to ZooKeeper ensemble=127.0.0.1:57105 2023-02-19 08:00:35,731 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:341190x0, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:35,733 DEBUG [Listener at localhost/41563] zookeeper.ZKUtil(164): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:35,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34119-0x1006b984b8f0001 connected 2023-02-19 08:00:35,733 DEBUG [Listener at localhost/41563] zookeeper.ZKUtil(164): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:35,734 DEBUG [Listener at localhost/41563] zookeeper.ZKUtil(164): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:35,736 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34119 2023-02-19 08:00:35,736 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34119 2023-02-19 08:00:35,736 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34119 2023-02-19 08:00:35,737 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34119 2023-02-19 08:00:35,737 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34119 2023-02-19 08:00:35,749 INFO [Listener at localhost/41563] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:35,750 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:35,750 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:35,750 INFO [Listener at localhost/41563] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:35,750 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:35,750 INFO [Listener at localhost/41563] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:35,750 INFO [Listener at localhost/41563] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:35,752 INFO [Listener at localhost/41563] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34875 2023-02-19 08:00:35,752 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:35,755 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:35,755 INFO [Listener at localhost/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,757 INFO [Listener at localhost/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,758 INFO [Listener at localhost/41563] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34875 connecting to ZooKeeper ensemble=127.0.0.1:57105 2023-02-19 08:00:35,763 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:348750x0, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:35,764 DEBUG [Listener at localhost/41563] zookeeper.ZKUtil(164): regionserver:348750x0, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:35,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34875-0x1006b984b8f0002 connected 2023-02-19 08:00:35,765 DEBUG [Listener at localhost/41563] zookeeper.ZKUtil(164): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:35,765 DEBUG [Listener at localhost/41563] zookeeper.ZKUtil(164): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:35,768 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34875 2023-02-19 08:00:35,770 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34875 2023-02-19 08:00:35,770 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34875 2023-02-19 08:00:35,772 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34875 2023-02-19 08:00:35,772 DEBUG [Listener at localhost/41563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34875 2023-02-19 08:00:35,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39791,1676793635299 2023-02-19 08:00:35,775 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:35,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39791,1676793635299 2023-02-19 08:00:35,776 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:35,776 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:35,776 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:35,776 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:35,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:35,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39791,1676793635299 from backup master directory 2023-02-19 08:00:35,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:35,781 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39791,1676793635299 2023-02-19 08:00:35,781 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:35,781 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:35,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39791,1676793635299 2023-02-19 08:00:35,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/hbase.id with ID: 52b0bcde-7b19-4f0f-8bf7-33e0ff5e0c66 2023-02-19 08:00:35,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:35,805 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:35,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x655d262d to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:35,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54f533a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:35,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:35,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 08:00:35,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:35,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/data/master/store-tmp 2023-02-19 08:00:35,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:35,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:35,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:35,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:35,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:35,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:35,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:35,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:35,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/WALs/jenkins-hbase4.apache.org,39791,1676793635299 2023-02-19 08:00:35,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39791%2C1676793635299, suffix=, logDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/WALs/jenkins-hbase4.apache.org,39791,1676793635299, archiveDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/oldWALs, maxLogs=10 2023-02-19 08:00:35,852 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34595,DS-1b1bc6a8-0dc2-4d91-9eb3-c97b7f18108e,DISK] 2023-02-19 08:00:35,853 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35303,DS-9536f868-7b4b-4a1e-96f0-c1676bfcd5e8,DISK] 2023-02-19 08:00:35,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/WALs/jenkins-hbase4.apache.org,39791,1676793635299/jenkins-hbase4.apache.org%2C39791%2C1676793635299.1676793635838 2023-02-19 08:00:35,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34595,DS-1b1bc6a8-0dc2-4d91-9eb3-c97b7f18108e,DISK], DatanodeInfoWithStorage[127.0.0.1:35303,DS-9536f868-7b4b-4a1e-96f0-c1676bfcd5e8,DISK]] 2023-02-19 08:00:35,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:35,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:35,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:35,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:35,857 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:35,858 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 08:00:35,858 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 08:00:35,859 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:35,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:35,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:35,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:35,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:35,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72690503, jitterRate=0.08317290246486664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:35,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:35,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 08:00:35,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 08:00:35,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 08:00:35,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 08:00:35,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 08:00:35,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 08:00:35,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 08:00:35,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 08:00:35,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 08:00:35,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 08:00:35,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 08:00:35,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 08:00:35,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 08:00:35,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 08:00:35,886 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:35,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 08:00:35,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 08:00:35,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 08:00:35,889 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:35,889 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:35,889 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:35,889 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:35,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39791,1676793635299, sessionid=0x1006b984b8f0000, setting cluster-up flag (Was=false) 2023-02-19 08:00:35,894 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:35,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 08:00:35,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39791,1676793635299 2023-02-19 08:00:35,901 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:35,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 08:00:35,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39791,1676793635299 2023-02-19 08:00:35,906 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.hbase-snapshot/.tmp 2023-02-19 08:00:35,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:35,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:35,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:35,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:35,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:35,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 08:00:35,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:35,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:35,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:35,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676793665912 2023-02-19 08:00:35,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 08:00:35,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 08:00:35,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 08:00:35,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 08:00:35,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 08:00:35,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 08:00:35,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:35,913 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:35,913 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 08:00:35,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 08:00:35,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 08:00:35,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 08:00:35,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 08:00:35,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 08:00:35,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793635914,5,FailOnTimeoutGroup] 2023-02-19 08:00:35,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793635914,5,FailOnTimeoutGroup] 2023-02-19 08:00:35,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:35,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 08:00:35,914 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:35,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:35,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:35,922 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:35,922 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:35,923 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e 2023-02-19 08:00:35,930 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:35,931 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:35,932 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/info 2023-02-19 08:00:35,933 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:35,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:35,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:35,934 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:35,935 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:35,935 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:35,935 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:35,937 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/table 2023-02-19 08:00:35,937 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:35,937 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:35,938 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740 2023-02-19 08:00:35,938 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740 2023-02-19 08:00:35,940 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:35,941 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:35,943 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:35,943 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66226986, jitterRate=-0.013141006231307983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:35,943 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:35,943 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:35,943 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:35,943 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:35,943 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:35,943 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:35,944 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:35,944 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:35,944 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:35,944 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 08:00:35,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 08:00:35,946 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 08:00:35,947 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 08:00:35,974 INFO [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(952): ClusterId : 52b0bcde-7b19-4f0f-8bf7-33e0ff5e0c66 2023-02-19 08:00:35,974 INFO [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(952): ClusterId : 52b0bcde-7b19-4f0f-8bf7-33e0ff5e0c66 2023-02-19 08:00:35,974 DEBUG [RS:1;jenkins-hbase4:34875] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:35,974 DEBUG [RS:0;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:35,976 DEBUG [RS:1;jenkins-hbase4:34875] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:35,976 DEBUG [RS:1;jenkins-hbase4:34875] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:35,976 DEBUG [RS:0;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:35,976 DEBUG [RS:0;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:35,984 DEBUG [RS:1;jenkins-hbase4:34875] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:35,985 DEBUG [RS:0;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:35,986 DEBUG [RS:1;jenkins-hbase4:34875] zookeeper.ReadOnlyZKClient(139): Connect 0x339923f3 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:35,986 DEBUG [RS:0;jenkins-hbase4:34119] zookeeper.ReadOnlyZKClient(139): Connect 0x5223ffbc to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:35,991 DEBUG [RS:1;jenkins-hbase4:34875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d5ecbf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:35,991 DEBUG [RS:0;jenkins-hbase4:34119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ce41b88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:35,991 DEBUG [RS:1;jenkins-hbase4:34875] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39614883, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:35,991 DEBUG [RS:0;jenkins-hbase4:34119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58db94cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:36,001 DEBUG [RS:1;jenkins-hbase4:34875] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34875 2023-02-19 08:00:36,001 INFO [RS:1;jenkins-hbase4:34875] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:36,001 INFO [RS:1;jenkins-hbase4:34875] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:36,001 DEBUG [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:36,001 INFO [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39791,1676793635299 with isa=jenkins-hbase4.apache.org/172.31.14.131:34875, startcode=1676793635749 2023-02-19 08:00:36,001 DEBUG [RS:1;jenkins-hbase4:34875] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:36,003 DEBUG [RS:0;jenkins-hbase4:34119] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34119 2023-02-19 08:00:36,003 INFO [RS:0;jenkins-hbase4:34119] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:36,003 INFO [RS:0;jenkins-hbase4:34119] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:36,003 DEBUG [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:36,003 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49359, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:36,003 INFO [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39791,1676793635299 with isa=jenkins-hbase4.apache.org/172.31.14.131:34119, startcode=1676793635698 2023-02-19 08:00:36,004 DEBUG [RS:0;jenkins-hbase4:34119] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:36,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:36,005 DEBUG [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e 2023-02-19 08:00:36,005 DEBUG [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40365 2023-02-19 08:00:36,005 DEBUG [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:36,006 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48001, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:36,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:36,007 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:36,007 DEBUG [RS:1;jenkins-hbase4:34875] zookeeper.ZKUtil(162): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:36,007 DEBUG [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e 2023-02-19 08:00:36,007 WARN [RS:1;jenkins-hbase4:34875] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:36,007 DEBUG [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40365 2023-02-19 08:00:36,007 DEBUG [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:36,007 INFO [RS:1;jenkins-hbase4:34875] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:36,007 DEBUG [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/WALs/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:36,012 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34875,1676793635749] 2023-02-19 08:00:36,012 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34119,1676793635698] 2023-02-19 08:00:36,012 DEBUG [RS:0;jenkins-hbase4:34119] zookeeper.ZKUtil(162): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:36,012 WARN [RS:0;jenkins-hbase4:34119] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:36,012 INFO [RS:0;jenkins-hbase4:34119] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:36,012 DEBUG [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/WALs/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:36,012 DEBUG [RS:1;jenkins-hbase4:34875] zookeeper.ZKUtil(162): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:36,013 DEBUG [RS:1;jenkins-hbase4:34875] zookeeper.ZKUtil(162): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:36,015 DEBUG [RS:1;jenkins-hbase4:34875] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:36,015 INFO [RS:1;jenkins-hbase4:34875] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:36,018 DEBUG [RS:0;jenkins-hbase4:34119] zookeeper.ZKUtil(162): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:36,018 INFO [RS:1;jenkins-hbase4:34875] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:36,018 DEBUG [RS:0;jenkins-hbase4:34119] zookeeper.ZKUtil(162): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:36,018 INFO [RS:1;jenkins-hbase4:34875] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:36,018 INFO [RS:1;jenkins-hbase4:34875] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,019 DEBUG [RS:0;jenkins-hbase4:34119] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:36,019 INFO [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:36,019 INFO [RS:0;jenkins-hbase4:34119] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:36,020 INFO [RS:1;jenkins-hbase4:34875] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,021 DEBUG [RS:1;jenkins-hbase4:34875] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,021 DEBUG [RS:1;jenkins-hbase4:34875] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,021 DEBUG [RS:1;jenkins-hbase4:34875] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,021 DEBUG [RS:1;jenkins-hbase4:34875] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,021 DEBUG [RS:1;jenkins-hbase4:34875] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,021 DEBUG [RS:1;jenkins-hbase4:34875] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:36,021 INFO [RS:0;jenkins-hbase4:34119] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:36,021 DEBUG [RS:1;jenkins-hbase4:34875] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,021 DEBUG [RS:1;jenkins-hbase4:34875] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,021 DEBUG [RS:1;jenkins-hbase4:34875] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,022 DEBUG [RS:1;jenkins-hbase4:34875] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,022 INFO [RS:0;jenkins-hbase4:34119] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:36,022 INFO [RS:0;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,023 INFO [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:36,023 INFO [RS:1;jenkins-hbase4:34875] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,023 INFO [RS:1;jenkins-hbase4:34875] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,024 INFO [RS:1;jenkins-hbase4:34875] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,024 INFO [RS:0;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,024 DEBUG [RS:0;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,024 DEBUG [RS:0;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,024 DEBUG [RS:0;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,024 DEBUG [RS:0;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,024 DEBUG [RS:0;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,024 DEBUG [RS:0;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:36,024 DEBUG [RS:0;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,024 DEBUG [RS:0;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,024 DEBUG [RS:0;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,024 DEBUG [RS:0;jenkins-hbase4:34119] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:36,025 INFO [RS:0;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,025 INFO [RS:0;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,025 INFO [RS:0;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,040 INFO [RS:1;jenkins-hbase4:34875] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:36,040 INFO [RS:1;jenkins-hbase4:34875] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34875,1676793635749-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,041 INFO [RS:0;jenkins-hbase4:34119] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:36,041 INFO [RS:0;jenkins-hbase4:34119] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34119,1676793635698-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,055 INFO [RS:1;jenkins-hbase4:34875] regionserver.Replication(203): jenkins-hbase4.apache.org,34875,1676793635749 started 2023-02-19 08:00:36,056 INFO [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34875,1676793635749, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34875, sessionid=0x1006b984b8f0002 2023-02-19 08:00:36,056 INFO [RS:0;jenkins-hbase4:34119] regionserver.Replication(203): jenkins-hbase4.apache.org,34119,1676793635698 started 2023-02-19 08:00:36,056 DEBUG [RS:1;jenkins-hbase4:34875] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:36,056 DEBUG [RS:1;jenkins-hbase4:34875] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:36,056 INFO [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34119,1676793635698, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34119, sessionid=0x1006b984b8f0001 2023-02-19 08:00:36,056 DEBUG [RS:0;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:36,056 DEBUG [RS:0;jenkins-hbase4:34119] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:36,056 DEBUG [RS:1;jenkins-hbase4:34875] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34875,1676793635749' 2023-02-19 08:00:36,056 DEBUG [RS:0;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34119,1676793635698' 2023-02-19 08:00:36,056 DEBUG [RS:0;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:36,056 DEBUG [RS:1;jenkins-hbase4:34875] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:36,056 DEBUG [RS:1;jenkins-hbase4:34875] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:36,057 DEBUG [RS:0;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:36,057 DEBUG [RS:1;jenkins-hbase4:34875] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:36,057 DEBUG [RS:1;jenkins-hbase4:34875] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:36,057 DEBUG [RS:0;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:36,057 DEBUG [RS:0;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:36,057 DEBUG [RS:0;jenkins-hbase4:34119] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:36,057 DEBUG [RS:1;jenkins-hbase4:34875] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:36,057 DEBUG [RS:1;jenkins-hbase4:34875] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34875,1676793635749' 2023-02-19 08:00:36,057 DEBUG [RS:0;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34119,1676793635698' 2023-02-19 08:00:36,057 DEBUG [RS:1;jenkins-hbase4:34875] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:36,057 DEBUG [RS:0;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:36,057 DEBUG [RS:1;jenkins-hbase4:34875] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:36,057 DEBUG [RS:0;jenkins-hbase4:34119] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:36,058 DEBUG [RS:1;jenkins-hbase4:34875] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:36,058 INFO [RS:1;jenkins-hbase4:34875] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:36,058 INFO [RS:1;jenkins-hbase4:34875] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:36,058 DEBUG [RS:0;jenkins-hbase4:34119] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:36,058 INFO [RS:0;jenkins-hbase4:34119] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:36,058 INFO [RS:0;jenkins-hbase4:34119] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:36,097 DEBUG [jenkins-hbase4:39791] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 08:00:36,097 DEBUG [jenkins-hbase4:39791] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:36,099 DEBUG [jenkins-hbase4:39791] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:36,099 DEBUG [jenkins-hbase4:39791] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:36,099 DEBUG [jenkins-hbase4:39791] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:36,100 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34119,1676793635698, state=OPENING 2023-02-19 08:00:36,102 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 08:00:36,103 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:36,103 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:36,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:36,258 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:36,258 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:36,260 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:36,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 08:00:36,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:36,266 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34119%2C1676793635698.meta, suffix=.meta, logDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/WALs/jenkins-hbase4.apache.org,34119,1676793635698, archiveDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/oldWALs, maxLogs=32 2023-02-19 08:00:36,282 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35303,DS-9536f868-7b4b-4a1e-96f0-c1676bfcd5e8,DISK] 2023-02-19 08:00:36,282 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34595,DS-1b1bc6a8-0dc2-4d91-9eb3-c97b7f18108e,DISK] 2023-02-19 08:00:36,284 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/WALs/jenkins-hbase4.apache.org,34119,1676793635698/jenkins-hbase4.apache.org%2C34119%2C1676793635698.meta.1676793636266.meta 2023-02-19 08:00:36,284 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35303,DS-9536f868-7b4b-4a1e-96f0-c1676bfcd5e8,DISK], DatanodeInfoWithStorage[127.0.0.1:34595,DS-1b1bc6a8-0dc2-4d91-9eb3-c97b7f18108e,DISK]] 2023-02-19 08:00:36,284 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:36,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 08:00:36,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 08:00:36,285 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 08:00:36,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 08:00:36,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 08:00:36,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 08:00:36,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:36,291 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/info 2023-02-19 08:00:36,291 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/info 2023-02-19 08:00:36,291 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:36,292 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:36,292 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:36,292 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:36,293 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:36,293 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:36,293 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:36,293 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:36,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/table 2023-02-19 08:00:36,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/table 2023-02-19 08:00:36,294 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:36,294 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:36,295 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740 2023-02-19 08:00:36,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740 2023-02-19 08:00:36,297 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:36,298 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:36,299 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65841486, jitterRate=-0.018885403871536255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:36,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:36,300 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676793636258 2023-02-19 08:00:36,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 08:00:36,306 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 08:00:36,306 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34119,1676793635698, state=OPEN 2023-02-19 08:00:36,307 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 08:00:36,307 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:36,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 08:00:36,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34119,1676793635698 in 204 msec 2023-02-19 08:00:36,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 08:00:36,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-19 08:00:36,311 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 403 msec 2023-02-19 08:00:36,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676793636311, completionTime=-1 2023-02-19 08:00:36,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 08:00:36,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 08:00:36,314 DEBUG [hconnection-0x18e3691a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:36,316 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60078, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:36,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 08:00:36,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676793696318 2023-02-19 08:00:36,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676793756318 2023-02-19 08:00:36,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-19 08:00:36,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39791,1676793635299-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39791,1676793635299-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39791,1676793635299-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39791, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:36,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 08:00:36,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:36,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 08:00:36,328 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 08:00:36,328 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:36,329 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:36,330 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:36,330 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e empty. 2023-02-19 08:00:36,331 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:36,331 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 08:00:36,350 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:36,351 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5c5d0ced748dfe08157ece5a212c900e, NAME => 'hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 5c5d0ced748dfe08157ece5a212c900e, disabling compactions & flushes 2023-02-19 08:00:36,367 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:36,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:36,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. after waiting 0 ms 2023-02-19 08:00:36,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:36,367 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:36,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 5c5d0ced748dfe08157ece5a212c900e: 2023-02-19 08:00:36,369 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:36,370 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793636370"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793636370"}]},"ts":"1676793636370"} 2023-02-19 08:00:36,372 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:36,373 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:36,373 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793636373"}]},"ts":"1676793636373"} 2023-02-19 08:00:36,374 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 08:00:36,376 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:36,377 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:36,377 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:36,377 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:36,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5c5d0ced748dfe08157ece5a212c900e, ASSIGN}] 2023-02-19 08:00:36,381 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5c5d0ced748dfe08157ece5a212c900e, ASSIGN 2023-02-19 08:00:36,381 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5c5d0ced748dfe08157ece5a212c900e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34119,1676793635698; forceNewPlan=false, retain=false 2023-02-19 08:00:36,532 INFO [jenkins-hbase4:39791] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:36,533 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5c5d0ced748dfe08157ece5a212c900e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:36,533 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793636533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793636533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793636533"}]},"ts":"1676793636533"} 2023-02-19 08:00:36,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5c5d0ced748dfe08157ece5a212c900e, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:36,691 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:36,693 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34119%2C1676793635698, suffix=, logDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/WALs/jenkins-hbase4.apache.org,34119,1676793635698, archiveDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/oldWALs, maxLogs=32 2023-02-19 08:00:36,707 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35303,DS-9536f868-7b4b-4a1e-96f0-c1676bfcd5e8,DISK] 2023-02-19 08:00:36,707 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34595,DS-1b1bc6a8-0dc2-4d91-9eb3-c97b7f18108e,DISK] 2023-02-19 08:00:36,709 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/WALs/jenkins-hbase4.apache.org,34119,1676793635698/jenkins-hbase4.apache.org%2C34119%2C1676793635698.1676793636693 2023-02-19 08:00:36,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35303,DS-9536f868-7b4b-4a1e-96f0-c1676bfcd5e8,DISK], DatanodeInfoWithStorage[127.0.0.1:34595,DS-1b1bc6a8-0dc2-4d91-9eb3-c97b7f18108e,DISK]] 2023-02-19 08:00:36,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5c5d0ced748dfe08157ece5a212c900e, NAME => 'hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:36,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:36,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:36,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:36,710 INFO [StoreOpener-5c5d0ced748dfe08157ece5a212c900e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:36,712 DEBUG [StoreOpener-5c5d0ced748dfe08157ece5a212c900e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e/info 2023-02-19 08:00:36,712 DEBUG [StoreOpener-5c5d0ced748dfe08157ece5a212c900e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e/info 2023-02-19 08:00:36,712 INFO [StoreOpener-5c5d0ced748dfe08157ece5a212c900e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c5d0ced748dfe08157ece5a212c900e columnFamilyName info 2023-02-19 08:00:36,713 INFO [StoreOpener-5c5d0ced748dfe08157ece5a212c900e-1] regionserver.HStore(310): Store=5c5d0ced748dfe08157ece5a212c900e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:36,713 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:36,714 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:36,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:36,717 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:36,718 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5c5d0ced748dfe08157ece5a212c900e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63152929, jitterRate=-0.05894802510738373}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:36,718 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5c5d0ced748dfe08157ece5a212c900e: 2023-02-19 08:00:36,718 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e., pid=6, masterSystemTime=1676793636687 2023-02-19 08:00:36,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:36,721 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:36,721 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5c5d0ced748dfe08157ece5a212c900e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:36,721 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793636721"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793636721"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793636721"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793636721"}]},"ts":"1676793636721"} 2023-02-19 08:00:36,723 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 08:00:36,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5c5d0ced748dfe08157ece5a212c900e, server=jenkins-hbase4.apache.org,34119,1676793635698 in 187 msec 2023-02-19 08:00:36,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 08:00:36,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5c5d0ced748dfe08157ece5a212c900e, ASSIGN in 347 msec 2023-02-19 08:00:36,725 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:36,726 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793636726"}]},"ts":"1676793636726"} 2023-02-19 08:00:36,727 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 08:00:36,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 08:00:36,729 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:36,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 403 msec 2023-02-19 08:00:36,730 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:36,730 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:36,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 08:00:36,740 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:36,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-19 08:00:36,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 08:00:36,750 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:36,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-19 08:00:36,759 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 08:00:36,761 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 08:00:36,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.980sec 2023-02-19 08:00:36,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 08:00:36,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 08:00:36,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 08:00:36,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39791,1676793635299-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 08:00:36,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39791,1676793635299-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 08:00:36,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 08:00:36,774 DEBUG [Listener at localhost/41563] zookeeper.ReadOnlyZKClient(139): Connect 0x34c09d85 to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:36,779 DEBUG [Listener at localhost/41563] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41900054, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:36,780 DEBUG [hconnection-0x45e59900-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:36,782 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60080, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:36,783 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39791,1676793635299 2023-02-19 08:00:36,783 DEBUG [Listener at localhost/41563] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 08:00:36,785 DEBUG [Listener at localhost/41563] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 08:00:36,787 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35718, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 08:00:36,787 INFO [Listener at localhost/41563] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-19 08:00:36,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-19 08:00:36,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 08:00:36,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 93 connection: 172.31.14.131:35718 deadline: 1676793696787, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-19 08:00:36,788 INFO [Listener at localhost/41563] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-19 08:00:36,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:36,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:36,792 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:36,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-19 08:00:36,793 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:36,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:36,801 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:36,801 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:36,801 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:36,801 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:36,801 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:36,801 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:36,801 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:36,801 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:36,801 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d empty. 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee empty. 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6 empty. 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008 empty. 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059 empty. 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3 empty. 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c empty. 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df empty. 2023-02-19 08:00:36,802 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:36,803 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:36,803 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:36,803 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:36,803 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1 empty. 2023-02-19 08:00:36,803 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:36,803 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8 empty. 2023-02-19 08:00:36,803 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:36,803 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:36,803 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:36,803 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-19 08:00:36,815 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:36,816 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2fa1f21598f651f89bf8b3beecc73a2c, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,816 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 92a06107ebec2862485dbcb7f2874d9d, NAME => 'testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,816 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5784037bf95e6150ae47bcf3f1ab95df, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,836 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,836 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 5784037bf95e6150ae47bcf3f1ab95df, disabling compactions & flushes 2023-02-19 08:00:36,836 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:36,837 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,837 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:36,837 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 92a06107ebec2862485dbcb7f2874d9d, disabling compactions & flushes 2023-02-19 08:00:36,837 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. after waiting 0 ms 2023-02-19 08:00:36,837 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:36,837 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:36,837 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:36,837 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:36,837 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 5784037bf95e6150ae47bcf3f1ab95df: 2023-02-19 08:00:36,837 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. after waiting 0 ms 2023-02-19 08:00:36,837 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:36,837 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:36,837 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 92a06107ebec2862485dbcb7f2874d9d: 2023-02-19 08:00:36,837 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7cd120d9a6330ee2369b2dd340b063a3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,838 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3f073903d539e891926b9ef2e87fb6ee, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,846 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 3f073903d539e891926b9ef2e87fb6ee, disabling compactions & flushes 2023-02-19 08:00:36,847 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:36,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:36,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. after waiting 0 ms 2023-02-19 08:00:36,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:36,847 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:36,847 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3f073903d539e891926b9ef2e87fb6ee: 2023-02-19 08:00:36,847 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 06c312aedf70a4991ddd0391628a8059, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,848 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,848 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 7cd120d9a6330ee2369b2dd340b063a3, disabling compactions & flushes 2023-02-19 08:00:36,848 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:36,848 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:36,848 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. after waiting 0 ms 2023-02-19 08:00:36,848 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:36,848 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:36,848 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 7cd120d9a6330ee2369b2dd340b063a3: 2023-02-19 08:00:36,849 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 684e488c070809f4f5884fcdc0a1cbc6, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,860 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,860 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 06c312aedf70a4991ddd0391628a8059, disabling compactions & flushes 2023-02-19 08:00:36,860 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:36,860 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:36,860 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. after waiting 0 ms 2023-02-19 08:00:36,860 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:36,860 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:36,860 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 06c312aedf70a4991ddd0391628a8059: 2023-02-19 08:00:36,860 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 43ef5036ff68800b16bea301e1b9c008, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,864 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,864 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 684e488c070809f4f5884fcdc0a1cbc6, disabling compactions & flushes 2023-02-19 08:00:36,864 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:36,864 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:36,864 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. after waiting 0 ms 2023-02-19 08:00:36,865 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:36,865 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:36,865 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 684e488c070809f4f5884fcdc0a1cbc6: 2023-02-19 08:00:36,865 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7a9428cd756e81c65eff8b60344624b8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 43ef5036ff68800b16bea301e1b9c008, disabling compactions & flushes 2023-02-19 08:00:36,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:36,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:36,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. after waiting 0 ms 2023-02-19 08:00:36,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:36,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:36,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 43ef5036ff68800b16bea301e1b9c008: 2023-02-19 08:00:36,871 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => a23407b898fabee7c34dfab313835fd1, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp 2023-02-19 08:00:36,872 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,872 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 7a9428cd756e81c65eff8b60344624b8, disabling compactions & flushes 2023-02-19 08:00:36,873 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:36,873 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:36,873 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. after waiting 0 ms 2023-02-19 08:00:36,873 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:36,873 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:36,873 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 7a9428cd756e81c65eff8b60344624b8: 2023-02-19 08:00:36,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:36,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing a23407b898fabee7c34dfab313835fd1, disabling compactions & flushes 2023-02-19 08:00:36,877 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:36,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:36,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. after waiting 0 ms 2023-02-19 08:00:36,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:36,877 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:36,877 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for a23407b898fabee7c34dfab313835fd1: 2023-02-19 08:00:36,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:37,060 INFO [RS:1;jenkins-hbase4:34875] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34875%2C1676793635749, suffix=, logDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/WALs/jenkins-hbase4.apache.org,34875,1676793635749, archiveDir=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/oldWALs, maxLogs=32 2023-02-19 08:00:37,077 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35303,DS-9536f868-7b4b-4a1e-96f0-c1676bfcd5e8,DISK] 2023-02-19 08:00:37,077 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34595,DS-1b1bc6a8-0dc2-4d91-9eb3-c97b7f18108e,DISK] 2023-02-19 08:00:37,079 INFO [RS:1;jenkins-hbase4:34875] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/WALs/jenkins-hbase4.apache.org,34875,1676793635749/jenkins-hbase4.apache.org%2C34875%2C1676793635749.1676793637060 2023-02-19 08:00:37,079 DEBUG [RS:1;jenkins-hbase4:34875] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35303,DS-9536f868-7b4b-4a1e-96f0-c1676bfcd5e8,DISK], DatanodeInfoWithStorage[127.0.0.1:34595,DS-1b1bc6a8-0dc2-4d91-9eb3-c97b7f18108e,DISK]] 2023-02-19 08:00:37,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:37,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 2fa1f21598f651f89bf8b3beecc73a2c, disabling compactions & flushes 2023-02-19 08:00:37,238 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:37,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:37,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. after waiting 0 ms 2023-02-19 08:00:37,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:37,238 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:37,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 2fa1f21598f651f89bf8b3beecc73a2c: 2023-02-19 08:00:37,240 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793637241"}]},"ts":"1676793637241"} 2023-02-19 08:00:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676793637241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793637241"}]},"ts":"1676793637241"} 2023-02-19 08:00:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793637241"}]},"ts":"1676793637241"} 2023-02-19 08:00:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793637241"}]},"ts":"1676793637241"} 2023-02-19 08:00:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793637241"}]},"ts":"1676793637241"} 2023-02-19 08:00:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793637241"}]},"ts":"1676793637241"} 2023-02-19 08:00:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793637241"}]},"ts":"1676793637241"} 2023-02-19 08:00:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793637241"}]},"ts":"1676793637241"} 2023-02-19 08:00:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676793637241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793637241"}]},"ts":"1676793637241"} 2023-02-19 08:00:37,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793637241"}]},"ts":"1676793637241"} 2023-02-19 08:00:37,245 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-19 08:00:37,245 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:37,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793637245"}]},"ts":"1676793637245"} 2023-02-19 08:00:37,247 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-19 08:00:37,251 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:37,260 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:37,260 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:37,260 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:37,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a06107ebec2862485dbcb7f2874d9d, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fa1f21598f651f89bf8b3beecc73a2c, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5784037bf95e6150ae47bcf3f1ab95df, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cd120d9a6330ee2369b2dd340b063a3, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f073903d539e891926b9ef2e87fb6ee, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=06c312aedf70a4991ddd0391628a8059, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=684e488c070809f4f5884fcdc0a1cbc6, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43ef5036ff68800b16bea301e1b9c008, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7a9428cd756e81c65eff8b60344624b8, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a23407b898fabee7c34dfab313835fd1, ASSIGN}] 2023-02-19 08:00:37,264 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fa1f21598f651f89bf8b3beecc73a2c, ASSIGN 2023-02-19 08:00:37,265 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a06107ebec2862485dbcb7f2874d9d, ASSIGN 2023-02-19 08:00:37,265 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5784037bf95e6150ae47bcf3f1ab95df, ASSIGN 2023-02-19 08:00:37,265 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f073903d539e891926b9ef2e87fb6ee, ASSIGN 2023-02-19 08:00:37,265 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fa1f21598f651f89bf8b3beecc73a2c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34875,1676793635749; forceNewPlan=false, retain=false 2023-02-19 08:00:37,266 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a06107ebec2862485dbcb7f2874d9d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34875,1676793635749; forceNewPlan=false, retain=false 2023-02-19 08:00:37,266 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5784037bf95e6150ae47bcf3f1ab95df, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34119,1676793635698; forceNewPlan=false, retain=false 2023-02-19 08:00:37,266 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f073903d539e891926b9ef2e87fb6ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34119,1676793635698; forceNewPlan=false, retain=false 2023-02-19 08:00:37,266 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a23407b898fabee7c34dfab313835fd1, ASSIGN 2023-02-19 08:00:37,267 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43ef5036ff68800b16bea301e1b9c008, ASSIGN 2023-02-19 08:00:37,267 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=684e488c070809f4f5884fcdc0a1cbc6, ASSIGN 2023-02-19 08:00:37,267 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7a9428cd756e81c65eff8b60344624b8, ASSIGN 2023-02-19 08:00:37,267 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=06c312aedf70a4991ddd0391628a8059, ASSIGN 2023-02-19 08:00:37,267 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a23407b898fabee7c34dfab313835fd1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34119,1676793635698; forceNewPlan=false, retain=false 2023-02-19 08:00:37,268 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43ef5036ff68800b16bea301e1b9c008, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34119,1676793635698; forceNewPlan=false, retain=false 2023-02-19 08:00:37,268 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=684e488c070809f4f5884fcdc0a1cbc6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34875,1676793635749; forceNewPlan=false, retain=false 2023-02-19 08:00:37,268 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=06c312aedf70a4991ddd0391628a8059, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34119,1676793635698; forceNewPlan=false, retain=false 2023-02-19 08:00:37,269 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cd120d9a6330ee2369b2dd340b063a3, ASSIGN 2023-02-19 08:00:37,269 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7a9428cd756e81c65eff8b60344624b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34875,1676793635749; forceNewPlan=false, retain=false 2023-02-19 08:00:37,269 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cd120d9a6330ee2369b2dd340b063a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34875,1676793635749; forceNewPlan=false, retain=false 2023-02-19 08:00:37,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:37,416 INFO [jenkins-hbase4:39791] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-19 08:00:37,424 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7cd120d9a6330ee2369b2dd340b063a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,424 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=684e488c070809f4f5884fcdc0a1cbc6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,424 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=2fa1f21598f651f89bf8b3beecc73a2c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,424 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=92a06107ebec2862485dbcb7f2874d9d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,424 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637424"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793637424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793637424"}]},"ts":"1676793637424"} 2023-02-19 08:00:37,424 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676793637424"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793637424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793637424"}]},"ts":"1676793637424"} 2023-02-19 08:00:37,424 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637424"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793637424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793637424"}]},"ts":"1676793637424"} 2023-02-19 08:00:37,424 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637424"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793637424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793637424"}]},"ts":"1676793637424"} 2023-02-19 08:00:37,427 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7a9428cd756e81c65eff8b60344624b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,428 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637427"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793637427"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793637427"}]},"ts":"1676793637427"} 2023-02-19 08:00:37,428 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=12, state=RUNNABLE; OpenRegionProcedure 2fa1f21598f651f89bf8b3beecc73a2c, server=jenkins-hbase4.apache.org,34875,1676793635749}] 2023-02-19 08:00:37,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure 92a06107ebec2862485dbcb7f2874d9d, server=jenkins-hbase4.apache.org,34875,1676793635749}] 2023-02-19 08:00:37,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure 684e488c070809f4f5884fcdc0a1cbc6, server=jenkins-hbase4.apache.org,34875,1676793635749}] 2023-02-19 08:00:37,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=06c312aedf70a4991ddd0391628a8059, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:37,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793637432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793637432"}]},"ts":"1676793637432"} 2023-02-19 08:00:37,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3f073903d539e891926b9ef2e87fb6ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:37,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=19, state=RUNNABLE; OpenRegionProcedure 7a9428cd756e81c65eff8b60344624b8, server=jenkins-hbase4.apache.org,34875,1676793635749}] 2023-02-19 08:00:37,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793637432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793637432"}]},"ts":"1676793637432"} 2023-02-19 08:00:37,434 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=43ef5036ff68800b16bea301e1b9c008, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:37,434 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637434"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793637434"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793637434"}]},"ts":"1676793637434"} 2023-02-19 08:00:37,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 7cd120d9a6330ee2369b2dd340b063a3, server=jenkins-hbase4.apache.org,34875,1676793635749}] 2023-02-19 08:00:37,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=16, state=RUNNABLE; OpenRegionProcedure 06c312aedf70a4991ddd0391628a8059, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:37,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure 3f073903d539e891926b9ef2e87fb6ee, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:37,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 43ef5036ff68800b16bea301e1b9c008, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:37,439 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a23407b898fabee7c34dfab313835fd1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:37,439 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676793637439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793637439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793637439"}]},"ts":"1676793637439"} 2023-02-19 08:00:37,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=20, state=RUNNABLE; OpenRegionProcedure a23407b898fabee7c34dfab313835fd1, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:37,442 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5784037bf95e6150ae47bcf3f1ab95df, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:37,442 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793637442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793637442"}]},"ts":"1676793637442"} 2023-02-19 08:00:37,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure 5784037bf95e6150ae47bcf3f1ab95df, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:37,580 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,580 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:37,582 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:37,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:37,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 92a06107ebec2862485dbcb7f2874d9d, NAME => 'testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-19 08:00:37,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:37,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:37,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:37,587 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:37,589 DEBUG [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/f1 2023-02-19 08:00:37,589 DEBUG [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/f1 2023-02-19 08:00:37,589 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92a06107ebec2862485dbcb7f2874d9d columnFamilyName f1 2023-02-19 08:00:37,589 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] regionserver.HStore(310): Store=92a06107ebec2862485dbcb7f2874d9d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,590 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:37,591 DEBUG [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/f2 2023-02-19 08:00:37,591 DEBUG [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/f2 2023-02-19 08:00:37,591 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92a06107ebec2862485dbcb7f2874d9d columnFamilyName f2 2023-02-19 08:00:37,592 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] regionserver.HStore(310): Store=92a06107ebec2862485dbcb7f2874d9d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:37,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:37,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:37,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 43ef5036ff68800b16bea301e1b9c008, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-19 08:00:37,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:37,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:37,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:37,595 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:37,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:37,596 DEBUG [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1 2023-02-19 08:00:37,596 DEBUG [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1 2023-02-19 08:00:37,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:37,596 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43ef5036ff68800b16bea301e1b9c008 columnFamilyName f1 2023-02-19 08:00:37,597 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] regionserver.HStore(310): Store=43ef5036ff68800b16bea301e1b9c008/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,597 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:37,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:37,598 DEBUG [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2 2023-02-19 08:00:37,598 DEBUG [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2 2023-02-19 08:00:37,598 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43ef5036ff68800b16bea301e1b9c008 columnFamilyName f2 2023-02-19 08:00:37,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 92a06107ebec2862485dbcb7f2874d9d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70592942, jitterRate=0.051916807889938354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:37,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 92a06107ebec2862485dbcb7f2874d9d: 2023-02-19 08:00:37,599 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] regionserver.HStore(310): Store=43ef5036ff68800b16bea301e1b9c008/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:37,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d., pid=22, masterSystemTime=1676793637580 2023-02-19 08:00:37,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:37,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:37,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:37,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:37,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7cd120d9a6330ee2369b2dd340b063a3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-19 08:00:37,603 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=92a06107ebec2862485dbcb7f2874d9d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:37,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:37,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:37,603 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676793637603"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793637603"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793637603"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793637603"}]},"ts":"1676793637603"} 2023-02-19 08:00:37,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:37,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:37,606 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:37,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-19 08:00:37,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure 92a06107ebec2862485dbcb7f2874d9d, server=jenkins-hbase4.apache.org,34875,1676793635749 in 177 msec 2023-02-19 08:00:37,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:37,607 DEBUG [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1 2023-02-19 08:00:37,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a06107ebec2862485dbcb7f2874d9d, ASSIGN in 346 msec 2023-02-19 08:00:37,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 43ef5036ff68800b16bea301e1b9c008; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71666857, jitterRate=0.06791938841342926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:37,608 DEBUG [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1 2023-02-19 08:00:37,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 43ef5036ff68800b16bea301e1b9c008: 2023-02-19 08:00:37,608 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7cd120d9a6330ee2369b2dd340b063a3 columnFamilyName f1 2023-02-19 08:00:37,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008., pid=28, masterSystemTime=1676793637590 2023-02-19 08:00:37,608 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 08:00:37,609 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] regionserver.HStore(310): Store=7cd120d9a6330ee2369b2dd340b063a3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,609 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:37,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:37,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:37,610 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=43ef5036ff68800b16bea301e1b9c008, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:37,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:37,610 DEBUG [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2 2023-02-19 08:00:37,610 DEBUG [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2 2023-02-19 08:00:37,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5784037bf95e6150ae47bcf3f1ab95df, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-19 08:00:37,610 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637610"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793637610"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793637610"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793637610"}]},"ts":"1676793637610"} 2023-02-19 08:00:37,611 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7cd120d9a6330ee2369b2dd340b063a3 columnFamilyName f2 2023-02-19 08:00:37,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:37,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:37,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:37,611 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] regionserver.HStore(310): Store=7cd120d9a6330ee2369b2dd340b063a3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:37,612 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:37,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:37,613 DEBUG [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1 2023-02-19 08:00:37,613 DEBUG [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1 2023-02-19 08:00:37,614 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5784037bf95e6150ae47bcf3f1ab95df columnFamilyName f1 2023-02-19 08:00:37,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:37,614 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] regionserver.HStore(310): Store=5784037bf95e6150ae47bcf3f1ab95df/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,614 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:37,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:37,619 DEBUG [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2 2023-02-19 08:00:37,619 DEBUG [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2 2023-02-19 08:00:37,619 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5784037bf95e6150ae47bcf3f1ab95df columnFamilyName f2 2023-02-19 08:00:37,620 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] regionserver.HStore(310): Store=5784037bf95e6150ae47bcf3f1ab95df/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-19 08:00:37,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 43ef5036ff68800b16bea301e1b9c008, server=jenkins-hbase4.apache.org,34119,1676793635698 in 181 msec 2023-02-19 08:00:37,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43ef5036ff68800b16bea301e1b9c008, ASSIGN in 359 msec 2023-02-19 08:00:37,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:37,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:37,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7cd120d9a6330ee2369b2dd340b063a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75178724, jitterRate=0.12025028467178345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:37,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:37,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7cd120d9a6330ee2369b2dd340b063a3: 2023-02-19 08:00:37,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3., pid=25, masterSystemTime=1676793637580 2023-02-19 08:00:37,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:37,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:37,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:37,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:37,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7a9428cd756e81c65eff8b60344624b8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-19 08:00:37,632 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7cd120d9a6330ee2369b2dd340b063a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,633 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793637632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793637632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793637632"}]},"ts":"1676793637632"} 2023-02-19 08:00:37,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:37,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:37,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:37,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:37,643 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:37,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-19 08:00:37,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 7cd120d9a6330ee2369b2dd340b063a3, server=jenkins-hbase4.apache.org,34875,1676793635749 in 199 msec 2023-02-19 08:00:37,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:37,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5784037bf95e6150ae47bcf3f1ab95df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62769213, jitterRate=-0.06466583907604218}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:37,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5784037bf95e6150ae47bcf3f1ab95df: 2023-02-19 08:00:37,645 DEBUG [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1 2023-02-19 08:00:37,645 DEBUG [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1 2023-02-19 08:00:37,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cd120d9a6330ee2369b2dd340b063a3, ASSIGN in 382 msec 2023-02-19 08:00:37,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df., pid=30, masterSystemTime=1676793637590 2023-02-19 08:00:37,645 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a9428cd756e81c65eff8b60344624b8 columnFamilyName f1 2023-02-19 08:00:37,646 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] regionserver.HStore(310): Store=7a9428cd756e81c65eff8b60344624b8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,646 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:37,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:37,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:37,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:37,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a23407b898fabee7c34dfab313835fd1, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-19 08:00:37,647 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5784037bf95e6150ae47bcf3f1ab95df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:37,648 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637647"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793637647"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793637647"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793637647"}]},"ts":"1676793637647"} 2023-02-19 08:00:37,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:37,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:37,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:37,649 DEBUG [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2 2023-02-19 08:00:37,649 DEBUG [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2 2023-02-19 08:00:37,650 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a9428cd756e81c65eff8b60344624b8 columnFamilyName f2 2023-02-19 08:00:37,650 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:37,650 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] regionserver.HStore(310): Store=7a9428cd756e81c65eff8b60344624b8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-19 08:00:37,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure 5784037bf95e6150ae47bcf3f1ab95df, server=jenkins-hbase4.apache.org,34119,1676793635698 in 206 msec 2023-02-19 08:00:37,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:37,652 DEBUG [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/f1 2023-02-19 08:00:37,652 DEBUG [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/f1 2023-02-19 08:00:37,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:37,652 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a23407b898fabee7c34dfab313835fd1 columnFamilyName f1 2023-02-19 08:00:37,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5784037bf95e6150ae47bcf3f1ab95df, ASSIGN in 390 msec 2023-02-19 08:00:37,654 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] regionserver.HStore(310): Store=a23407b898fabee7c34dfab313835fd1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,655 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:37,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:37,656 DEBUG [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/f2 2023-02-19 08:00:37,656 DEBUG [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/f2 2023-02-19 08:00:37,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:37,657 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a23407b898fabee7c34dfab313835fd1 columnFamilyName f2 2023-02-19 08:00:37,658 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] regionserver.HStore(310): Store=a23407b898fabee7c34dfab313835fd1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:37,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:37,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:37,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:37,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:37,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a23407b898fabee7c34dfab313835fd1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65932919, jitterRate=-0.017522946000099182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:37,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a23407b898fabee7c34dfab313835fd1: 2023-02-19 08:00:37,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1., pid=29, masterSystemTime=1676793637590 2023-02-19 08:00:37,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:37,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7a9428cd756e81c65eff8b60344624b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70001822, jitterRate=0.04310843348503113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:37,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7a9428cd756e81c65eff8b60344624b8: 2023-02-19 08:00:37,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:37,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:37,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8., pid=24, masterSystemTime=1676793637580 2023-02-19 08:00:37,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:37,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 06c312aedf70a4991ddd0391628a8059, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-19 08:00:37,675 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=a23407b898fabee7c34dfab313835fd1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:37,675 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676793637675"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793637675"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793637675"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793637675"}]},"ts":"1676793637675"} 2023-02-19 08:00:37,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:37,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:37,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:37,677 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7a9428cd756e81c65eff8b60344624b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,677 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793637677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793637677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793637677"}]},"ts":"1676793637677"} 2023-02-19 08:00:37,678 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:37,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:37,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:37,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:37,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 684e488c070809f4f5884fcdc0a1cbc6, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-19 08:00:37,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:37,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:37,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:37,684 DEBUG [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1 2023-02-19 08:00:37,684 DEBUG [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1 2023-02-19 08:00:37,684 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06c312aedf70a4991ddd0391628a8059 columnFamilyName f1 2023-02-19 08:00:37,685 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] regionserver.HStore(310): Store=06c312aedf70a4991ddd0391628a8059/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,685 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:37,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=20 2023-02-19 08:00:37,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=20, state=SUCCESS; OpenRegionProcedure a23407b898fabee7c34dfab313835fd1, server=jenkins-hbase4.apache.org,34119,1676793635698 in 243 msec 2023-02-19 08:00:37,690 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:37,690 DEBUG [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2 2023-02-19 08:00:37,691 DEBUG [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2 2023-02-19 08:00:37,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=19 2023-02-19 08:00:37,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a23407b898fabee7c34dfab313835fd1, ASSIGN in 425 msec 2023-02-19 08:00:37,691 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06c312aedf70a4991ddd0391628a8059 columnFamilyName f2 2023-02-19 08:00:37,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=19, state=SUCCESS; OpenRegionProcedure 7a9428cd756e81c65eff8b60344624b8, server=jenkins-hbase4.apache.org,34875,1676793635749 in 253 msec 2023-02-19 08:00:37,692 DEBUG [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1 2023-02-19 08:00:37,692 DEBUG [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1 2023-02-19 08:00:37,692 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 684e488c070809f4f5884fcdc0a1cbc6 columnFamilyName f1 2023-02-19 08:00:37,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7a9428cd756e81c65eff8b60344624b8, ASSIGN in 430 msec 2023-02-19 08:00:37,693 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] regionserver.HStore(310): Store=684e488c070809f4f5884fcdc0a1cbc6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,693 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:37,694 DEBUG [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2 2023-02-19 08:00:37,694 DEBUG [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2 2023-02-19 08:00:37,694 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] regionserver.HStore(310): Store=06c312aedf70a4991ddd0391628a8059/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,694 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 684e488c070809f4f5884fcdc0a1cbc6 columnFamilyName f2 2023-02-19 08:00:37,695 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] regionserver.HStore(310): Store=684e488c070809f4f5884fcdc0a1cbc6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:37,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:37,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:37,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:37,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:37,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:37,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:37,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:37,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:37,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 06c312aedf70a4991ddd0391628a8059; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68391816, jitterRate=0.01911747455596924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:37,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 06c312aedf70a4991ddd0391628a8059: 2023-02-19 08:00:37,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059., pid=26, masterSystemTime=1676793637590 2023-02-19 08:00:37,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:37,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:37,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:37,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:37,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f073903d539e891926b9ef2e87fb6ee, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-19 08:00:37,705 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=06c312aedf70a4991ddd0391628a8059, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:37,705 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637704"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793637704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793637704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793637704"}]},"ts":"1676793637704"} 2023-02-19 08:00:37,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:37,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:37,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:37,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 684e488c070809f4f5884fcdc0a1cbc6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59115898, jitterRate=-0.11910447478294373}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:37,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 684e488c070809f4f5884fcdc0a1cbc6: 2023-02-19 08:00:37,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6., pid=23, masterSystemTime=1676793637580 2023-02-19 08:00:37,707 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:37,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:37,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:37,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:37,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2fa1f21598f651f89bf8b3beecc73a2c, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-19 08:00:37,710 DEBUG [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1 2023-02-19 08:00:37,710 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=684e488c070809f4f5884fcdc0a1cbc6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:37,710 DEBUG [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1 2023-02-19 08:00:37,710 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637709"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793637709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793637709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793637709"}]},"ts":"1676793637709"} 2023-02-19 08:00:37,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:37,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:37,710 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f073903d539e891926b9ef2e87fb6ee columnFamilyName f1 2023-02-19 08:00:37,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=16 2023-02-19 08:00:37,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:37,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=16, state=SUCCESS; OpenRegionProcedure 06c312aedf70a4991ddd0391628a8059, server=jenkins-hbase4.apache.org,34119,1676793635698 in 270 msec 2023-02-19 08:00:37,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=06c312aedf70a4991ddd0391628a8059, ASSIGN in 449 msec 2023-02-19 08:00:37,716 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] regionserver.HStore(310): Store=3f073903d539e891926b9ef2e87fb6ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,716 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:37,717 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:37,718 DEBUG [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2 2023-02-19 08:00:37,718 DEBUG [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2 2023-02-19 08:00:37,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-19 08:00:37,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure 684e488c070809f4f5884fcdc0a1cbc6, server=jenkins-hbase4.apache.org,34875,1676793635749 in 285 msec 2023-02-19 08:00:37,718 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f073903d539e891926b9ef2e87fb6ee columnFamilyName f2 2023-02-19 08:00:37,719 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] regionserver.HStore(310): Store=3f073903d539e891926b9ef2e87fb6ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,721 DEBUG [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1 2023-02-19 08:00:37,721 DEBUG [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1 2023-02-19 08:00:37,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=684e488c070809f4f5884fcdc0a1cbc6, ASSIGN in 457 msec 2023-02-19 08:00:37,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:37,721 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fa1f21598f651f89bf8b3beecc73a2c columnFamilyName f1 2023-02-19 08:00:37,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:37,721 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] regionserver.HStore(310): Store=2fa1f21598f651f89bf8b3beecc73a2c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,722 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:37,723 DEBUG [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2 2023-02-19 08:00:37,723 DEBUG [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2 2023-02-19 08:00:37,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:37,723 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fa1f21598f651f89bf8b3beecc73a2c columnFamilyName f2 2023-02-19 08:00:37,723 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] regionserver.HStore(310): Store=2fa1f21598f651f89bf8b3beecc73a2c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:37,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:37,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:37,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:37,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:37,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:37,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3f073903d539e891926b9ef2e87fb6ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68752188, jitterRate=0.024487435817718506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:37,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3f073903d539e891926b9ef2e87fb6ee: 2023-02-19 08:00:37,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee., pid=27, masterSystemTime=1676793637590 2023-02-19 08:00:37,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:37,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:37,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:37,728 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3f073903d539e891926b9ef2e87fb6ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:37,729 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637728"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793637728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793637728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793637728"}]},"ts":"1676793637728"} 2023-02-19 08:00:37,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:37,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2fa1f21598f651f89bf8b3beecc73a2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60624288, jitterRate=-0.09662771224975586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:37,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2fa1f21598f651f89bf8b3beecc73a2c: 2023-02-19 08:00:37,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c., pid=21, masterSystemTime=1676793637580 2023-02-19 08:00:37,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:37,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:37,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-19 08:00:37,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure 3f073903d539e891926b9ef2e87fb6ee, server=jenkins-hbase4.apache.org,34119,1676793635698 in 293 msec 2023-02-19 08:00:37,731 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=2fa1f21598f651f89bf8b3beecc73a2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:37,731 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793637731"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793637731"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793637731"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793637731"}]},"ts":"1676793637731"} 2023-02-19 08:00:37,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f073903d539e891926b9ef2e87fb6ee, ASSIGN in 470 msec 2023-02-19 08:00:37,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=12 2023-02-19 08:00:37,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=12, state=SUCCESS; OpenRegionProcedure 2fa1f21598f651f89bf8b3beecc73a2c, server=jenkins-hbase4.apache.org,34875,1676793635749 in 304 msec 2023-02-19 08:00:37,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-19 08:00:37,735 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fa1f21598f651f89bf8b3beecc73a2c, ASSIGN in 472 msec 2023-02-19 08:00:37,735 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:37,735 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793637735"}]},"ts":"1676793637735"} 2023-02-19 08:00:37,736 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-19 08:00:37,739 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:37,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 949 msec 2023-02-19 08:00:37,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:37,899 INFO [Listener at localhost/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-19 08:00:37,900 DEBUG [Listener at localhost/41563] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-19 08:00:37,900 INFO [Listener at localhost/41563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:37,903 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-19 08:00:37,903 INFO [Listener at localhost/41563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:37,903 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-19 08:00:37,903 INFO [Listener at localhost/41563] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 08:00:37,984 DEBUG [hconnection-0x45e59900-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:37,993 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34119] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:37,998 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60994, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:38,004 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34875] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:38,067 INFO [Listener at localhost/41563] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 08:00:38,067 INFO [Listener at localhost/41563] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 08:00:38,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-19 08:00:38,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676793638069 (current time:1676793638069). 2023-02-19 08:00:38,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 08:00:38,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] zookeeper.ReadOnlyZKClient(139): Connect 0x7e2dae5d to 127.0.0.1:57105 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:38,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25976943, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:38,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:38,077 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60088, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:38,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e2dae5d to 127.0.0.1:57105 2023-02-19 08:00:38,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:38,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 08:00:38,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-19 08:00:38,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-19 08:00:38,082 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-19 08:00:38,083 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676794238083 2023-02-19 08:00:38,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-19 08:00:38,083 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,085 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:38,085 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 08:00:38,086 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-19 08:00:38,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-19 08:00:38,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-19 08:00:38,094 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-19 08:00:38,095 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676794238095 2023-02-19 08:00:38,185 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:38,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 08:00:38,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:38,187 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 08:00:38,387 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:38,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 08:00:38,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:38,388 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-19 08:00:38,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,516 INFO [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-19 08:00:38,516 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:38,516 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-19 08:00:38,516 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-19 08:00:38,517 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,517 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,518 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:38,518 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:38,518 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:38,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:38,518 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,518 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,519 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,519 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:38,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-19 08:00:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-19 08:00:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-19 08:00:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-19 08:00:38,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,520 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-19 08:00:38,520 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:38,522 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 08:00:38,522 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 08:00:38,522 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1676793635698' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 08:00:38,522 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-19 08:00:38,522 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:38,522 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 08:00:38,522 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 08:00:38,522 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34875,1676793635749' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 08:00:38,524 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,524 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:38,525 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,525 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,525 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:38,526 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:38,526 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,526 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:38,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34119,1676793635698' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 08:00:38,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17b24ee1[Count = 1] remaining members to acquire global barrier 2023-02-19 08:00:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:38,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34875,1676793635749' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 08:00:38,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17b24ee1[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:38,529 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-19 08:00:38,529 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,530 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,530 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,530 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 08:00:38,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,530 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,530 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 08:00:38,530 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:38,530 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:38,530 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. started... 2023-02-19 08:00:38,530 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. started... 2023-02-19 08:00:38,530 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 08:00:38,530 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 08:00:38,530 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,531 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 43ef5036ff68800b16bea301e1b9c008 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:38,531 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-19 08:00:38,531 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:38,531 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:38,531 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:38,531 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5784037bf95e6150ae47bcf3f1ab95df 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:38,530 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:38,531 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. started... 2023-02-19 08:00:38,531 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. started... 2023-02-19 08:00:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 08:00:38,531 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. started... 2023-02-19 08:00:38,533 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7cd120d9a6330ee2369b2dd340b063a3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:38,532 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 92a06107ebec2862485dbcb7f2874d9d: 2023-02-19 08:00:38,532 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. started... 2023-02-19 08:00:38,534 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7a9428cd756e81c65eff8b60344624b8 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 08:00:38,534 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a23407b898fabee7c34dfab313835fd1: 2023-02-19 08:00:38,534 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,535 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,535 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:38,535 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:38,535 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:38,535 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:38,535 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:38,535 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-19 08:00:38,555 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. completed. 2023-02-19 08:00:38,555 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:38,555 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:38,555 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. started... 2023-02-19 08:00:38,558 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 684e488c070809f4f5884fcdc0a1cbc6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:38,558 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 08:00:38,558 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. completed. 2023-02-19 08:00:38,558 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:38,558 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:38,558 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. started... 2023-02-19 08:00:38,558 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-19 08:00:38,559 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 3f073903d539e891926b9ef2e87fb6ee 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:38,560 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/.tmp/f1/f4c276c747f74f9c9c49e0efba672236 2023-02-19 08:00:38,562 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/.tmp/f1/d9b11bf23182450ea70fb0d872580f31 2023-02-19 08:00:38,562 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/.tmp/f1/eb15731b539c46ac96fe6b1baf42c66b 2023-02-19 08:00:38,563 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/.tmp/f1/a5c875c397c94f96885497821d6badd4 2023-02-19 08:00:38,636 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/.tmp/f1/43b2b2efd8814209a3afb51e264d8953 2023-02-19 08:00:38,657 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/.tmp/f2/0324c09d3d4c4d9ca4027841338fe864 2023-02-19 08:00:38,664 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/.tmp/f1/f4c276c747f74f9c9c49e0efba672236 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/f4c276c747f74f9c9c49e0efba672236 2023-02-19 08:00:38,669 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/f4c276c747f74f9c9c49e0efba672236, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,670 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/.tmp/f2/0324c09d3d4c4d9ca4027841338fe864 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/0324c09d3d4c4d9ca4027841338fe864 2023-02-19 08:00:38,671 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/.tmp/f2/e9aad53c32f048a0b924c6b6e8aa715b 2023-02-19 08:00:38,671 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/.tmp/f1/278911e33c72411689d3cc659bfa296c 2023-02-19 08:00:38,683 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/0324c09d3d4c4d9ca4027841338fe864, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,684 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5784037bf95e6150ae47bcf3f1ab95df in 153ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:38,684 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-19 08:00:38,685 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5784037bf95e6150ae47bcf3f1ab95df: 2023-02-19 08:00:38,685 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,685 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:38,685 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/f4c276c747f74f9c9c49e0efba672236] hfiles 2023-02-19 08:00:38,685 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/f4c276c747f74f9c9c49e0efba672236 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,685 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/0324c09d3d4c4d9ca4027841338fe864] hfiles 2023-02-19 08:00:38,685 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/0324c09d3d4c4d9ca4027841338fe864 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,688 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:38,690 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/.tmp/f2/f34a966994ae4b87bff061c9fa230c2a 2023-02-19 08:00:38,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 08:00:38,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:38,691 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-19 08:00:38,692 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/.tmp/f1/d9b11bf23182450ea70fb0d872580f31 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/d9b11bf23182450ea70fb0d872580f31 2023-02-19 08:00:38,692 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/.tmp/f2/5fa23b7821b64e2bba87492ed1e4a42e 2023-02-19 08:00:38,704 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/d9b11bf23182450ea70fb0d872580f31, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,704 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/.tmp/f1/eb15731b539c46ac96fe6b1baf42c66b as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/eb15731b539c46ac96fe6b1baf42c66b 2023-02-19 08:00:38,705 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/.tmp/f1/a5c875c397c94f96885497821d6badd4 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/a5c875c397c94f96885497821d6badd4 2023-02-19 08:00:38,705 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/.tmp/f2/e9aad53c32f048a0b924c6b6e8aa715b as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/e9aad53c32f048a0b924c6b6e8aa715b 2023-02-19 08:00:38,711 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/eb15731b539c46ac96fe6b1baf42c66b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,712 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/e9aad53c32f048a0b924c6b6e8aa715b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,713 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7cd120d9a6330ee2369b2dd340b063a3 in 180ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:38,714 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/.tmp/f2/5fa23b7821b64e2bba87492ed1e4a42e as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/5fa23b7821b64e2bba87492ed1e4a42e 2023-02-19 08:00:38,716 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7cd120d9a6330ee2369b2dd340b063a3: 2023-02-19 08:00:38,716 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. completed. 2023-02-19 08:00:38,716 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:38,716 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:38,716 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,716 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:38,716 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. started... 2023-02-19 08:00:38,716 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/d9b11bf23182450ea70fb0d872580f31] hfiles 2023-02-19 08:00:38,716 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/d9b11bf23182450ea70fb0d872580f31 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,716 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 08:00:38,718 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/e9aad53c32f048a0b924c6b6e8aa715b] hfiles 2023-02-19 08:00:38,718 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/e9aad53c32f048a0b924c6b6e8aa715b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,717 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 06c312aedf70a4991ddd0391628a8059 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-19 08:00:38,718 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/a5c875c397c94f96885497821d6badd4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:38,719 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/.tmp/f2/f34a966994ae4b87bff061c9fa230c2a as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/f34a966994ae4b87bff061c9fa230c2a 2023-02-19 08:00:38,721 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/.tmp/f2/139f258bfc8140c6b9e9912e5c7e4269 2023-02-19 08:00:38,723 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/5fa23b7821b64e2bba87492ed1e4a42e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,723 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 43ef5036ff68800b16bea301e1b9c008 in 192ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:38,723 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 43ef5036ff68800b16bea301e1b9c008: 2023-02-19 08:00:38,724 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,724 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:38,724 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/eb15731b539c46ac96fe6b1baf42c66b] hfiles 2023-02-19 08:00:38,724 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/eb15731b539c46ac96fe6b1baf42c66b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,724 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/5fa23b7821b64e2bba87492ed1e4a42e] hfiles 2023-02-19 08:00:38,724 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/5fa23b7821b64e2bba87492ed1e4a42e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,724 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/.tmp/f2/069e992bb1cb4861981f0002291fe1ec 2023-02-19 08:00:38,728 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/f34a966994ae4b87bff061c9fa230c2a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:38,729 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 7a9428cd756e81c65eff8b60344624b8 in 195ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:38,729 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7a9428cd756e81c65eff8b60344624b8: 2023-02-19 08:00:38,729 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,729 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:38,729 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/a5c875c397c94f96885497821d6badd4] hfiles 2023-02-19 08:00:38,729 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/a5c875c397c94f96885497821d6badd4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,729 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/f34a966994ae4b87bff061c9fa230c2a] hfiles 2023-02-19 08:00:38,729 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/f34a966994ae4b87bff061c9fa230c2a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,732 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. completed. 2023-02-19 08:00:38,732 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:38,732 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:38,732 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-19 08:00:38,732 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. started... 2023-02-19 08:00:38,733 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 2fa1f21598f651f89bf8b3beecc73a2c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-19 08:00:38,735 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/.tmp/f1/278911e33c72411689d3cc659bfa296c as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/278911e33c72411689d3cc659bfa296c 2023-02-19 08:00:38,737 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/.tmp/f1/43b2b2efd8814209a3afb51e264d8953 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/43b2b2efd8814209a3afb51e264d8953 2023-02-19 08:00:38,737 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/.tmp/f1/6e5d7ae80d1747f782ff87df759e1b65 2023-02-19 08:00:38,740 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/278911e33c72411689d3cc659bfa296c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,743 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/.tmp/f2/139f258bfc8140c6b9e9912e5c7e4269 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/139f258bfc8140c6b9e9912e5c7e4269 2023-02-19 08:00:38,752 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/43b2b2efd8814209a3afb51e264d8953, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,752 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/139f258bfc8140c6b9e9912e5c7e4269, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,753 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. completed. 2023-02-19 08:00:38,753 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:38,753 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 08:00:38,753 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/.tmp/f2/069e992bb1cb4861981f0002291fe1ec as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/069e992bb1cb4861981f0002291fe1ec 2023-02-19 08:00:38,757 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3f073903d539e891926b9ef2e87fb6ee in 198ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:38,757 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3f073903d539e891926b9ef2e87fb6ee: 2023-02-19 08:00:38,757 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,757 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:38,757 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/278911e33c72411689d3cc659bfa296c] hfiles 2023-02-19 08:00:38,757 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/278911e33c72411689d3cc659bfa296c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,757 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/139f258bfc8140c6b9e9912e5c7e4269] hfiles 2023-02-19 08:00:38,757 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/139f258bfc8140c6b9e9912e5c7e4269 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,759 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/069e992bb1cb4861981f0002291fe1ec, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,760 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 684e488c070809f4f5884fcdc0a1cbc6 in 202ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:38,760 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 684e488c070809f4f5884fcdc0a1cbc6: 2023-02-19 08:00:38,760 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,760 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:38,760 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/43b2b2efd8814209a3afb51e264d8953] hfiles 2023-02-19 08:00:38,760 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/43b2b2efd8814209a3afb51e264d8953 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,760 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/069e992bb1cb4861981f0002291fe1ec] hfiles 2023-02-19 08:00:38,760 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/069e992bb1cb4861981f0002291fe1ec for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,764 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. completed. 2023-02-19 08:00:38,764 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:38,764 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-19 08:00:38,764 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/.tmp/f2/2ea12fa2380a42d0952f941047988e7d 2023-02-19 08:00:38,766 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/.tmp/f1/f4786bdeabbc439db3f6a512dd506f0c 2023-02-19 08:00:38,781 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. completed. 2023-02-19 08:00:38,782 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:38,782 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. completed. 2023-02-19 08:00:38,782 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:38,782 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 08:00:38,782 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-19 08:00:38,785 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/.tmp/f1/6e5d7ae80d1747f782ff87df759e1b65 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/6e5d7ae80d1747f782ff87df759e1b65 2023-02-19 08:00:38,789 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/6e5d7ae80d1747f782ff87df759e1b65, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,790 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/.tmp/f2/2ea12fa2380a42d0952f941047988e7d as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/2ea12fa2380a42d0952f941047988e7d 2023-02-19 08:00:38,790 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/.tmp/f2/b95aa65500494fc7abcad8a6bf551eb8 2023-02-19 08:00:38,794 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/2ea12fa2380a42d0952f941047988e7d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-19 08:00:38,795 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 06c312aedf70a4991ddd0391628a8059 in 78ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:38,795 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/.tmp/f1/f4786bdeabbc439db3f6a512dd506f0c as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/f4786bdeabbc439db3f6a512dd506f0c 2023-02-19 08:00:38,795 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 06c312aedf70a4991ddd0391628a8059: 2023-02-19 08:00:38,795 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,795 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:38,795 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/6e5d7ae80d1747f782ff87df759e1b65] hfiles 2023-02-19 08:00:38,795 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/6e5d7ae80d1747f782ff87df759e1b65 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,795 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/2ea12fa2380a42d0952f941047988e7d] hfiles 2023-02-19 08:00:38,796 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/2ea12fa2380a42d0952f941047988e7d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,799 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/f4786bdeabbc439db3f6a512dd506f0c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:38,800 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/.tmp/f2/b95aa65500494fc7abcad8a6bf551eb8 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/b95aa65500494fc7abcad8a6bf551eb8 2023-02-19 08:00:38,801 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. completed. 2023-02-19 08:00:38,801 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:38,801 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 08:00:38,801 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 08:00:38,801 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,802 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 08:00:38,802 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34119,1676793635698' in zk 2023-02-19 08:00:38,803 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:38,803 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 08:00:38,804 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:38,804 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 08:00:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34119,1676793635698': 2023-02-19 08:00:38,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34119,1676793635698' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 08:00:38,811 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/b95aa65500494fc7abcad8a6bf551eb8, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-19 08:00:38,812 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 2fa1f21598f651f89bf8b3beecc73a2c in 79ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:38,812 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2fa1f21598f651f89bf8b3beecc73a2c: 2023-02-19 08:00:38,812 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,812 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:38,812 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/f4786bdeabbc439db3f6a512dd506f0c] hfiles 2023-02-19 08:00:38,812 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/f4786bdeabbc439db3f6a512dd506f0c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,812 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/b95aa65500494fc7abcad8a6bf551eb8] hfiles 2023-02-19 08:00:38,812 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/b95aa65500494fc7abcad8a6bf551eb8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,817 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. completed. 2023-02-19 08:00:38,818 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-19 08:00:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-19 08:00:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 08:00:38,818 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34875,1676793635749' in zk 2023-02-19 08:00:38,820 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 08:00:38,820 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:38,820 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,820 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 08:00:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34875,1676793635749': 2023-02-19 08:00:38,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34875,1676793635749' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 08:00:38,823 INFO [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-19 08:00:38,823 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:38,823 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:38,823 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,823 INFO [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 08:00:38,824 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,824 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,825 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:38,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,824 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:38,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,825 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:38,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:38,825 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,825 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,827 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,827 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,832 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,832 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,832 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:38,832 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:38,832 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:38,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:38,832 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion because node does not exist (not an error) 2023-02-19 08:00:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:38,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,832 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:38,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:38,832 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:38,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:38,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,832 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:38,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:38,833 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:38,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:38,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:38,833 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,833 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:38,833 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,833 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-19 08:00:38,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,892 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:38,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676793638083Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676793638832 (+749 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676793638833 (+1 ms)Writing data manifest for testWithMockedMapReduceMultiRegion at 1676793638841 (+8 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676793638852 (+11 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676793638891 (+39 ms) 2023-02-19 08:00:38,894 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-19 08:00:38,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 809 msec 2023-02-19 08:00:39,191 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:39,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-19 08:00:39,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 08:00:39,192 INFO [Listener at localhost/41563] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 08:00:39,197 INFO [Listener at localhost/41563] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 08:00:39,204 INFO [Listener at localhost/41563] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 08:00:39,230 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34119] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:39,230 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34875] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:39,295 INFO [Listener at localhost/41563] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 08:00:39,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 08:00:39,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,314 INFO [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-19 08:00:39,314 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:39,315 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-19 08:00:39,315 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-19 08:00:39,315 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,315 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,317 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:39,317 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:39,317 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:39,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:39,317 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,317 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,318 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,318 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:39,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:39,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:39,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,318 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-19 08:00:39,318 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:39,323 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 08:00:39,323 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,323 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:39,324 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. started... 2023-02-19 08:00:39,324 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-19 08:00:39,324 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:39,324 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:39,324 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7a9428cd756e81c65eff8b60344624b8 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 08:00:39,324 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. started... 2023-02-19 08:00:39,324 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 08:00:39,325 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 08:00:39,324 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-19 08:00:39,325 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:39,325 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7cd120d9a6330ee2369b2dd340b063a3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:39,325 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. started... 2023-02-19 08:00:39,325 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:39,325 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 92a06107ebec2862485dbcb7f2874d9d: 2023-02-19 08:00:39,325 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:39,325 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. started... 2023-02-19 08:00:39,325 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5784037bf95e6150ae47bcf3f1ab95df 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:39,325 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:39,325 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. started... 2023-02-19 08:00:39,325 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 43ef5036ff68800b16bea301e1b9c008 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:39,328 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-19 08:00:39,328 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 08:00:39,328 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 08:00:39,328 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:39,332 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. started... 2023-02-19 08:00:39,333 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 684e488c070809f4f5884fcdc0a1cbc6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:39,329 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:39,333 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. started... 2023-02-19 08:00:39,333 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a23407b898fabee7c34dfab313835fd1: 2023-02-19 08:00:39,333 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:39,333 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:39,333 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. started... 2023-02-19 08:00:39,333 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-19 08:00:39,333 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3f073903d539e891926b9ef2e87fb6ee 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:39,368 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/.tmp/f1/5b413c241ecd4a9fa5dda32b32e5ce10 2023-02-19 08:00:39,368 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/.tmp/f1/27555e80be9f4f3cba572538dd341dfb 2023-02-19 08:00:39,368 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/.tmp/f1/718236e06eb847a1b175ea7bdf07b824 2023-02-19 08:00:39,375 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/.tmp/f1/4510b8b602c74018a1bbdc82104c655b 2023-02-19 08:00:39,380 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/.tmp/f1/c516ee87e8ea4cec89a1b645ca9bb139 2023-02-19 08:00:39,388 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/.tmp/f2/e4ac392929d34bfdbdf4cda5f1b4a6db 2023-02-19 08:00:39,400 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/.tmp/f1/57436b020a9a41d196faa4477eab14ca 2023-02-19 08:00:39,401 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/.tmp/f2/1830106049e04eb0bbfbe75b4237c717 2023-02-19 08:00:39,402 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/.tmp/f1/718236e06eb847a1b175ea7bdf07b824 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/718236e06eb847a1b175ea7bdf07b824 2023-02-19 08:00:39,407 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/.tmp/f1/5b413c241ecd4a9fa5dda32b32e5ce10 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/5b413c241ecd4a9fa5dda32b32e5ce10 2023-02-19 08:00:39,408 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/718236e06eb847a1b175ea7bdf07b824, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:39,409 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/.tmp/f2/e4ac392929d34bfdbdf4cda5f1b4a6db as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/e4ac392929d34bfdbdf4cda5f1b4a6db 2023-02-19 08:00:39,413 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/5b413c241ecd4a9fa5dda32b32e5ce10, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,413 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/e4ac392929d34bfdbdf4cda5f1b4a6db, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:39,414 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/.tmp/f2/1830106049e04eb0bbfbe75b4237c717 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/1830106049e04eb0bbfbe75b4237c717 2023-02-19 08:00:39,414 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 7a9428cd756e81c65eff8b60344624b8 in 90ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:39,414 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7a9428cd756e81c65eff8b60344624b8: 2023-02-19 08:00:39,415 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:39,415 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:39,415 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 08:00:39,415 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. started... 2023-02-19 08:00:39,415 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2fa1f21598f651f89bf8b3beecc73a2c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-19 08:00:39,417 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/.tmp/f2/6b27fe4b5e414729b31995e1e32e6b29 2023-02-19 08:00:39,418 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/.tmp/f2/a702c8fc15c842a28742b2d372fc2040 2023-02-19 08:00:39,424 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/.tmp/f2/af06512279c84f1295500ae0d43e3311 2023-02-19 08:00:39,424 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/.tmp/f2/0f40d0e1365d4d02b6f776322344a27f 2023-02-19 08:00:39,425 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/.tmp/f1/4510b8b602c74018a1bbdc82104c655b as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/4510b8b602c74018a1bbdc82104c655b 2023-02-19 08:00:39,425 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/1830106049e04eb0bbfbe75b4237c717, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,425 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/.tmp/f1/27555e80be9f4f3cba572538dd341dfb as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/27555e80be9f4f3cba572538dd341dfb 2023-02-19 08:00:39,426 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 684e488c070809f4f5884fcdc0a1cbc6 in 94ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:39,426 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 684e488c070809f4f5884fcdc0a1cbc6: 2023-02-19 08:00:39,426 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:39,426 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 08:00:39,430 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/.tmp/f1/c516ee87e8ea4cec89a1b645ca9bb139 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/c516ee87e8ea4cec89a1b645ca9bb139 2023-02-19 08:00:39,431 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/27555e80be9f4f3cba572538dd341dfb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,432 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/4510b8b602c74018a1bbdc82104c655b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,432 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/.tmp/f1/57436b020a9a41d196faa4477eab14ca as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/57436b020a9a41d196faa4477eab14ca 2023-02-19 08:00:39,432 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/.tmp/f2/6b27fe4b5e414729b31995e1e32e6b29 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/6b27fe4b5e414729b31995e1e32e6b29 2023-02-19 08:00:39,433 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/.tmp/f2/a702c8fc15c842a28742b2d372fc2040 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/a702c8fc15c842a28742b2d372fc2040 2023-02-19 08:00:39,436 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/c516ee87e8ea4cec89a1b645ca9bb139, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,438 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/.tmp/f2/af06512279c84f1295500ae0d43e3311 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/af06512279c84f1295500ae0d43e3311 2023-02-19 08:00:39,439 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/a702c8fc15c842a28742b2d372fc2040, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,440 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7cd120d9a6330ee2369b2dd340b063a3 in 114ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:39,440 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7cd120d9a6330ee2369b2dd340b063a3: 2023-02-19 08:00:39,440 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:39,440 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 08:00:39,445 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/6b27fe4b5e414729b31995e1e32e6b29, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,445 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/af06512279c84f1295500ae0d43e3311, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,446 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/57436b020a9a41d196faa4477eab14ca, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,446 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 43ef5036ff68800b16bea301e1b9c008 in 121ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:39,446 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3f073903d539e891926b9ef2e87fb6ee in 113ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:39,446 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 43ef5036ff68800b16bea301e1b9c008: 2023-02-19 08:00:39,446 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3f073903d539e891926b9ef2e87fb6ee: 2023-02-19 08:00:39,446 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:39,446 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:39,446 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-19 08:00:39,446 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-19 08:00:39,446 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:39,446 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/.tmp/f2/0f40d0e1365d4d02b6f776322344a27f as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/0f40d0e1365d4d02b6f776322344a27f 2023-02-19 08:00:39,446 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. started... 2023-02-19 08:00:39,447 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 06c312aedf70a4991ddd0391628a8059 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-19 08:00:39,449 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/.tmp/f1/d07edd1be1e1494296a683b8ef712af0 2023-02-19 08:00:39,453 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/0f40d0e1365d4d02b6f776322344a27f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,453 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5784037bf95e6150ae47bcf3f1ab95df in 128ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:39,453 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5784037bf95e6150ae47bcf3f1ab95df: 2023-02-19 08:00:39,453 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:39,454 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-19 08:00:39,459 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/.tmp/f1/01c565c27d7b44daa472bdf90784e0ba 2023-02-19 08:00:39,462 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/.tmp/f2/6d7d0235fa6f45c596a552359ddaa60b 2023-02-19 08:00:39,466 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/.tmp/f1/d07edd1be1e1494296a683b8ef712af0 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/d07edd1be1e1494296a683b8ef712af0 2023-02-19 08:00:39,473 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/d07edd1be1e1494296a683b8ef712af0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:39,474 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/.tmp/f2/6d7d0235fa6f45c596a552359ddaa60b as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/6d7d0235fa6f45c596a552359ddaa60b 2023-02-19 08:00:39,479 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/.tmp/f2/1721025f74f74a858efc6f6d653f69c5 2023-02-19 08:00:39,480 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/6d7d0235fa6f45c596a552359ddaa60b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-19 08:00:39,481 INFO [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 2fa1f21598f651f89bf8b3beecc73a2c in 66ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:39,481 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2fa1f21598f651f89bf8b3beecc73a2c: 2023-02-19 08:00:39,481 DEBUG [rs(jenkins-hbase4.apache.org,34875,1676793635749)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 08:00:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 08:00:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 08:00:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34875,1676793635749' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 08:00:39,483 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,483 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:39,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:39,485 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:39,485 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:39,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:39,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:39,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34875,1676793635749' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 08:00:39,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@138dd8cf[Count = 1] remaining members to acquire global barrier 2023-02-19 08:00:39,488 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/.tmp/f1/01c565c27d7b44daa472bdf90784e0ba as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/01c565c27d7b44daa472bdf90784e0ba 2023-02-19 08:00:39,493 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/01c565c27d7b44daa472bdf90784e0ba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,494 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/.tmp/f2/1721025f74f74a858efc6f6d653f69c5 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/1721025f74f74a858efc6f6d653f69c5 2023-02-19 08:00:39,499 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/1721025f74f74a858efc6f6d653f69c5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-19 08:00:39,500 INFO [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 06c312aedf70a4991ddd0391628a8059 in 54ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:39,500 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 06c312aedf70a4991ddd0391628a8059: 2023-02-19 08:00:39,500 DEBUG [rs(jenkins-hbase4.apache.org,34119,1676793635698)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:39,500 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-19 08:00:39,500 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-19 08:00:39,500 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,500 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-19 08:00:39,500 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34119,1676793635698' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-19 08:00:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,502 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:39,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:39,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34119,1676793635698' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-19 08:00:39,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@138dd8cf[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:39,504 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-19 08:00:39,504 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,505 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,505 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,506 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,506 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 08:00:39,506 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 08:00:39,506 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34875,1676793635749' in zk 2023-02-19 08:00:39,506 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-19 08:00:39,506 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-19 08:00:39,506 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34119,1676793635698' in zk 2023-02-19 08:00:39,506 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,506 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:39,507 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 08:00:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,34875,1676793635749' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 08:00:39,507 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,507 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-19 08:00:39,508 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:39,508 DEBUG [member: 'jenkins-hbase4.apache.org,34119,1676793635698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-19 08:00:39,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:39,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:39,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34875,1676793635749': 2023-02-19 08:00:39,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34875,1676793635749' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-19 08:00:39,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:39,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:39,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:39,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:39,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34119,1676793635698': 2023-02-19 08:00:39,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34119,1676793635698' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-19 08:00:39,512 INFO [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-19 08:00:39,512 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:39,512 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:39,512 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,512 INFO [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 08:00:39,513 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,513 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:39,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:39,513 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:39,513 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,514 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:39,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:39,514 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:39,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:39,515 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:39,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,516 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:39,516 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:39,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:39,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:39,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-19 08:00:39,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 08:00:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:39,520 DEBUG [(jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:39,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:39,521 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 08:00:39,520 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:39,521 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,621 DEBUG [Listener at localhost/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 08:00:39,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 08:00:39,627 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676793638069 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:39,627 DEBUG [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,627 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(239): region to add: 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(239): region to add: 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(239): region to add: 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(239): region to add: a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(239): region to add: 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(239): region to add: 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(239): region to add: 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(239): region to add: 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(239): region to add: 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(239): region to add: 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(585): clone region=43ef5036ff68800b16bea301e1b9c008 as 43ef5036ff68800b16bea301e1b9c008 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(585): clone region=5784037bf95e6150ae47bcf3f1ab95df as 5784037bf95e6150ae47bcf3f1ab95df in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(585): clone region=7a9428cd756e81c65eff8b60344624b8 as 7a9428cd756e81c65eff8b60344624b8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(585): clone region=a23407b898fabee7c34dfab313835fd1 as a23407b898fabee7c34dfab313835fd1 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(585): clone region=3f073903d539e891926b9ef2e87fb6ee as 3f073903d539e891926b9ef2e87fb6ee in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(585): clone region=7cd120d9a6330ee2369b2dd340b063a3 as 7cd120d9a6330ee2369b2dd340b063a3 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(585): clone region=92a06107ebec2862485dbcb7f2874d9d as 92a06107ebec2862485dbcb7f2874d9d in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(585): clone region=684e488c070809f4f5884fcdc0a1cbc6 as 684e488c070809f4f5884fcdc0a1cbc6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(585): clone region=06c312aedf70a4991ddd0391628a8059 as 06c312aedf70a4991ddd0391628a8059 in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,628 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(585): clone region=2fa1f21598f651f89bf8b3beecc73a2c as 2fa1f21598f651f89bf8b3beecc73a2c in snapshot testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,630 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 7cd120d9a6330ee2369b2dd340b063a3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,630 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 684e488c070809f4f5884fcdc0a1cbc6, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,630 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 3f073903d539e891926b9ef2e87fb6ee, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,631 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7a9428cd756e81c65eff8b60344624b8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,631 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5784037bf95e6150ae47bcf3f1ab95df, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,632 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => a23407b898fabee7c34dfab313835fd1, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,632 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 43ef5036ff68800b16bea301e1b9c008, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,633 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 92a06107ebec2862485dbcb7f2874d9d, NAME => 'testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,661 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:39,661 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a5c875c397c94f96885497821d6badd4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,664 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:39,664 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 278911e33c72411689d3cc659bfa296c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,672 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f34a966994ae4b87bff061c9fa230c2a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,676 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 139f258bfc8140c6b9e9912e5c7e4269 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,677 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:39,677 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 43b2b2efd8814209a3afb51e264d8953 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,678 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:39,678 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d9b11bf23182450ea70fb0d872580f31 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,680 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 7a9428cd756e81c65eff8b60344624b8, disabling compactions & flushes 2023-02-19 08:00:39,680 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:39,681 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:39,681 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. after waiting 0 ms 2023-02-19 08:00:39,681 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:39,681 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:39,681 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 7a9428cd756e81c65eff8b60344624b8: 2023-02-19 08:00:39,681 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 06c312aedf70a4991ddd0391628a8059, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,681 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:39,682 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing a23407b898fabee7c34dfab313835fd1, disabling compactions & flushes 2023-02-19 08:00:39,682 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:39,682 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:39,682 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. after waiting 0 ms 2023-02-19 08:00:39,682 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:39,682 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:39,682 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:39,682 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:39,682 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 92a06107ebec2862485dbcb7f2874d9d, disabling compactions & flushes 2023-02-19 08:00:39,682 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for a23407b898fabee7c34dfab313835fd1: 2023-02-19 08:00:39,682 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:39,682 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f4c276c747f74f9c9c49e0efba672236 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,683 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:39,683 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. after waiting 0 ms 2023-02-19 08:00:39,683 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 2fa1f21598f651f89bf8b3beecc73a2c, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,683 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:39,683 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:39,683 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 92a06107ebec2862485dbcb7f2874d9d: 2023-02-19 08:00:39,683 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 3f073903d539e891926b9ef2e87fb6ee, disabling compactions & flushes 2023-02-19 08:00:39,683 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:39,683 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:39,683 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eb15731b539c46ac96fe6b1baf42c66b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,683 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:39,684 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. after waiting 0 ms 2023-02-19 08:00:39,684 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:39,684 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:39,684 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 3f073903d539e891926b9ef2e87fb6ee: 2023-02-19 08:00:39,688 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 069e992bb1cb4861981f0002291fe1ec from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,689 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e9aad53c32f048a0b924c6b6e8aa715b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,689 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0324c09d3d4c4d9ca4027841338fe864 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,696 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5fa23b7821b64e2bba87492ed1e4a42e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,696 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 684e488c070809f4f5884fcdc0a1cbc6, disabling compactions & flushes 2023-02-19 08:00:39,696 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:39,696 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:39,696 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. after waiting 0 ms 2023-02-19 08:00:39,696 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:39,696 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:39,696 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 684e488c070809f4f5884fcdc0a1cbc6: 2023-02-19 08:00:39,698 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 5784037bf95e6150ae47bcf3f1ab95df, disabling compactions & flushes 2023-02-19 08:00:39,698 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:39,698 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:39,698 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 7cd120d9a6330ee2369b2dd340b063a3, disabling compactions & flushes 2023-02-19 08:00:39,698 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. after waiting 0 ms 2023-02-19 08:00:39,698 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:39,698 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:39,698 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:39,698 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:39,698 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. after waiting 0 ms 2023-02-19 08:00:39,698 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 5784037bf95e6150ae47bcf3f1ab95df: 2023-02-19 08:00:39,698 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:39,698 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:39,699 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 7cd120d9a6330ee2369b2dd340b063a3: 2023-02-19 08:00:39,699 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 43ef5036ff68800b16bea301e1b9c008, disabling compactions & flushes 2023-02-19 08:00:39,699 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:39,699 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:39,699 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. after waiting 0 ms 2023-02-19 08:00:39,699 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:39,699 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:39,699 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 43ef5036ff68800b16bea301e1b9c008: 2023-02-19 08:00:39,702 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:39,702 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f4786bdeabbc439db3f6a512dd506f0c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,702 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:39,702 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6e5d7ae80d1747f782ff87df759e1b65 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,705 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b95aa65500494fc7abcad8a6bf551eb8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,705 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2ea12fa2380a42d0952f941047988e7d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:39,707 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 2fa1f21598f651f89bf8b3beecc73a2c, disabling compactions & flushes 2023-02-19 08:00:39,707 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:39,707 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:39,707 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. after waiting 0 ms 2023-02-19 08:00:39,707 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:39,707 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:39,707 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 2fa1f21598f651f89bf8b3beecc73a2c: 2023-02-19 08:00:39,707 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 06c312aedf70a4991ddd0391628a8059, disabling compactions & flushes 2023-02-19 08:00:39,707 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:39,707 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:39,707 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. after waiting 0 ms 2023-02-19 08:00:39,707 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:39,707 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:39,707 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 06c312aedf70a4991ddd0391628a8059: 2023-02-19 08:00:39,707 INFO [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676793638069 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:39,707 DEBUG [Listener at localhost/41563] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,707 DEBUG [Listener at localhost/41563] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00 2023-02-19 08:00:39,708 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-data/ 2023-02-19 08:00:39,708 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----default/ 2023-02-19 08:00:39,709 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-19 08:00:39,709 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----------06c312aedf70a4991ddd0391628a8059/ 2023-02-19 08:00:39,710 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:39,710 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:39,710 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=06c312aedf70a4991ddd0391628a8059-6e5d7ae80d1747f782ff87df759e1b65 2023-02-19 08:00:39,710 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:39,710 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=06c312aedf70a4991ddd0391628a8059-2ea12fa2380a42d0952f941047988e7d 2023-02-19 08:00:39,711 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----------2fa1f21598f651f89bf8b3beecc73a2c/ 2023-02-19 08:00:39,711 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:39,711 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:39,712 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2fa1f21598f651f89bf8b3beecc73a2c-f4786bdeabbc439db3f6a512dd506f0c 2023-02-19 08:00:39,712 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:39,712 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2fa1f21598f651f89bf8b3beecc73a2c-b95aa65500494fc7abcad8a6bf551eb8 2023-02-19 08:00:39,712 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----------3f073903d539e891926b9ef2e87fb6ee/ 2023-02-19 08:00:39,713 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:39,713 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:39,713 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3f073903d539e891926b9ef2e87fb6ee-278911e33c72411689d3cc659bfa296c 2023-02-19 08:00:39,713 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:39,714 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3f073903d539e891926b9ef2e87fb6ee-139f258bfc8140c6b9e9912e5c7e4269 2023-02-19 08:00:39,714 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----------43ef5036ff68800b16bea301e1b9c008/ 2023-02-19 08:00:39,714 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:39,714 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:39,715 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=43ef5036ff68800b16bea301e1b9c008-eb15731b539c46ac96fe6b1baf42c66b 2023-02-19 08:00:39,715 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:39,715 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=43ef5036ff68800b16bea301e1b9c008-5fa23b7821b64e2bba87492ed1e4a42e 2023-02-19 08:00:39,715 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----------5784037bf95e6150ae47bcf3f1ab95df/ 2023-02-19 08:00:39,716 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:39,716 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:39,719 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5784037bf95e6150ae47bcf3f1ab95df-f4c276c747f74f9c9c49e0efba672236 2023-02-19 08:00:39,719 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:39,719 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5784037bf95e6150ae47bcf3f1ab95df-0324c09d3d4c4d9ca4027841338fe864 2023-02-19 08:00:39,719 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----------684e488c070809f4f5884fcdc0a1cbc6/ 2023-02-19 08:00:39,720 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:39,720 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:39,720 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=684e488c070809f4f5884fcdc0a1cbc6-43b2b2efd8814209a3afb51e264d8953 2023-02-19 08:00:39,720 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:39,721 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=684e488c070809f4f5884fcdc0a1cbc6-069e992bb1cb4861981f0002291fe1ec 2023-02-19 08:00:39,721 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----------7a9428cd756e81c65eff8b60344624b8/ 2023-02-19 08:00:39,721 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:39,721 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:39,722 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7a9428cd756e81c65eff8b60344624b8-a5c875c397c94f96885497821d6badd4 2023-02-19 08:00:39,722 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:39,722 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7a9428cd756e81c65eff8b60344624b8-f34a966994ae4b87bff061c9fa230c2a 2023-02-19 08:00:39,722 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----------7cd120d9a6330ee2369b2dd340b063a3/ 2023-02-19 08:00:39,722 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:39,722 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:39,723 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7cd120d9a6330ee2369b2dd340b063a3-d9b11bf23182450ea70fb0d872580f31 2023-02-19 08:00:39,723 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:39,723 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7cd120d9a6330ee2369b2dd340b063a3-e9aad53c32f048a0b924c6b6e8aa715b 2023-02-19 08:00:39,723 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----------92a06107ebec2862485dbcb7f2874d9d/ 2023-02-19 08:00:39,724 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:39,724 DEBUG [Listener at localhost/41563] util.CommonFSUtils(699): |----------a23407b898fabee7c34dfab313835fd1/ 2023-02-19 08:00:39,724 DEBUG [Listener at localhost/41563] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:39,729 INFO [Listener at localhost/41563] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 08:00:40,293 DEBUG [Listener at localhost/41563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:40,294 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:40,295 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:40,297 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:40,298 DEBUG [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1 2023-02-19 08:00:40,298 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06c312aedf70a4991ddd0391628a8059 columnFamilyName f1 2023-02-19 08:00:40,302 DEBUG [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/testWithMockedMapReduceMultiRegion=06c312aedf70a4991ddd0391628a8059-6e5d7ae80d1747f782ff87df759e1b65 2023-02-19 08:00:40,302 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] regionserver.HStore(310): Store=06c312aedf70a4991ddd0391628a8059/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,302 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:40,303 DEBUG [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2 2023-02-19 08:00:40,303 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06c312aedf70a4991ddd0391628a8059 columnFamilyName f2 2023-02-19 08:00:40,307 DEBUG [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/testWithMockedMapReduceMultiRegion=06c312aedf70a4991ddd0391628a8059-2ea12fa2380a42d0952f941047988e7d 2023-02-19 08:00:40,307 INFO [StoreOpener-06c312aedf70a4991ddd0391628a8059-1] regionserver.HStore(310): Store=06c312aedf70a4991ddd0391628a8059/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,307 DEBUG [Listener at localhost/41563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:40,307 INFO [Listener at localhost/41563] regionserver.HRegion(1071): Opened 06c312aedf70a4991ddd0391628a8059; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63960654, jitterRate=-0.04691198468208313}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:40,307 DEBUG [Listener at localhost/41563] regionserver.HRegion(964): Region open journal for 06c312aedf70a4991ddd0391628a8059: 2023-02-19 08:00:40,316 DEBUG [Listener at localhost/41563] regionserver.HRegion(1603): Closing 06c312aedf70a4991ddd0391628a8059, disabling compactions & flushes 2023-02-19 08:00:40,316 INFO [Listener at localhost/41563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:40,316 DEBUG [Listener at localhost/41563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:40,316 DEBUG [Listener at localhost/41563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. after waiting 0 ms 2023-02-19 08:00:40,316 DEBUG [Listener at localhost/41563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:40,317 INFO [Listener at localhost/41563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:40,317 DEBUG [Listener at localhost/41563] regionserver.HRegion(1557): Region close journal for 06c312aedf70a4991ddd0391628a8059: 2023-02-19 08:00:40,317 DEBUG [Listener at localhost/41563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:40,317 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:40,320 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:40,321 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:40,322 DEBUG [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1 2023-02-19 08:00:40,323 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 684e488c070809f4f5884fcdc0a1cbc6 columnFamilyName f1 2023-02-19 08:00:40,328 DEBUG [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/testWithMockedMapReduceMultiRegion=684e488c070809f4f5884fcdc0a1cbc6-43b2b2efd8814209a3afb51e264d8953 2023-02-19 08:00:40,328 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] regionserver.HStore(310): Store=684e488c070809f4f5884fcdc0a1cbc6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,328 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:40,329 DEBUG [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2 2023-02-19 08:00:40,329 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 684e488c070809f4f5884fcdc0a1cbc6 columnFamilyName f2 2023-02-19 08:00:40,333 DEBUG [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/testWithMockedMapReduceMultiRegion=684e488c070809f4f5884fcdc0a1cbc6-069e992bb1cb4861981f0002291fe1ec 2023-02-19 08:00:40,333 INFO [StoreOpener-684e488c070809f4f5884fcdc0a1cbc6-1] regionserver.HStore(310): Store=684e488c070809f4f5884fcdc0a1cbc6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,333 DEBUG [Listener at localhost/41563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:40,333 INFO [Listener at localhost/41563] regionserver.HRegion(1071): Opened 684e488c070809f4f5884fcdc0a1cbc6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63691833, jitterRate=-0.05091772973537445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:40,333 DEBUG [Listener at localhost/41563] regionserver.HRegion(964): Region open journal for 684e488c070809f4f5884fcdc0a1cbc6: 2023-02-19 08:00:40,341 DEBUG [Listener at localhost/41563] regionserver.HRegion(1603): Closing 684e488c070809f4f5884fcdc0a1cbc6, disabling compactions & flushes 2023-02-19 08:00:40,342 INFO [Listener at localhost/41563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:40,342 DEBUG [Listener at localhost/41563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:40,342 DEBUG [Listener at localhost/41563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. after waiting 0 ms 2023-02-19 08:00:40,342 DEBUG [Listener at localhost/41563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:40,343 INFO [Listener at localhost/41563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:40,343 DEBUG [Listener at localhost/41563] regionserver.HRegion(1557): Region close journal for 684e488c070809f4f5884fcdc0a1cbc6: 2023-02-19 08:00:40,344 DEBUG [Listener at localhost/41563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:40,344 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:40,347 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:40,349 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:40,349 DEBUG [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1 2023-02-19 08:00:40,350 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fa1f21598f651f89bf8b3beecc73a2c columnFamilyName f1 2023-02-19 08:00:40,353 DEBUG [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/testWithMockedMapReduceMultiRegion=2fa1f21598f651f89bf8b3beecc73a2c-f4786bdeabbc439db3f6a512dd506f0c 2023-02-19 08:00:40,353 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] regionserver.HStore(310): Store=2fa1f21598f651f89bf8b3beecc73a2c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,353 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:40,354 DEBUG [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2 2023-02-19 08:00:40,354 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fa1f21598f651f89bf8b3beecc73a2c columnFamilyName f2 2023-02-19 08:00:40,357 DEBUG [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/testWithMockedMapReduceMultiRegion=2fa1f21598f651f89bf8b3beecc73a2c-b95aa65500494fc7abcad8a6bf551eb8 2023-02-19 08:00:40,357 INFO [StoreOpener-2fa1f21598f651f89bf8b3beecc73a2c-1] regionserver.HStore(310): Store=2fa1f21598f651f89bf8b3beecc73a2c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,357 DEBUG [Listener at localhost/41563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:40,358 INFO [Listener at localhost/41563] regionserver.HRegion(1071): Opened 2fa1f21598f651f89bf8b3beecc73a2c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72401620, jitterRate=0.07886821031570435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:40,358 DEBUG [Listener at localhost/41563] regionserver.HRegion(964): Region open journal for 2fa1f21598f651f89bf8b3beecc73a2c: 2023-02-19 08:00:40,368 DEBUG [Listener at localhost/41563] regionserver.HRegion(1603): Closing 2fa1f21598f651f89bf8b3beecc73a2c, disabling compactions & flushes 2023-02-19 08:00:40,368 INFO [Listener at localhost/41563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:40,368 DEBUG [Listener at localhost/41563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:40,368 DEBUG [Listener at localhost/41563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. after waiting 0 ms 2023-02-19 08:00:40,368 DEBUG [Listener at localhost/41563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:40,369 INFO [Listener at localhost/41563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:40,369 DEBUG [Listener at localhost/41563] regionserver.HRegion(1557): Region close journal for 2fa1f21598f651f89bf8b3beecc73a2c: 2023-02-19 08:00:40,370 DEBUG [Listener at localhost/41563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:40,370 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:40,371 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:40,373 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:40,373 DEBUG [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1 2023-02-19 08:00:40,374 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f073903d539e891926b9ef2e87fb6ee columnFamilyName f1 2023-02-19 08:00:40,377 DEBUG [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/testWithMockedMapReduceMultiRegion=3f073903d539e891926b9ef2e87fb6ee-278911e33c72411689d3cc659bfa296c 2023-02-19 08:00:40,377 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] regionserver.HStore(310): Store=3f073903d539e891926b9ef2e87fb6ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,377 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:40,378 DEBUG [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2 2023-02-19 08:00:40,378 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f073903d539e891926b9ef2e87fb6ee columnFamilyName f2 2023-02-19 08:00:40,381 DEBUG [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/testWithMockedMapReduceMultiRegion=3f073903d539e891926b9ef2e87fb6ee-139f258bfc8140c6b9e9912e5c7e4269 2023-02-19 08:00:40,382 INFO [StoreOpener-3f073903d539e891926b9ef2e87fb6ee-1] regionserver.HStore(310): Store=3f073903d539e891926b9ef2e87fb6ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,382 DEBUG [Listener at localhost/41563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:40,382 INFO [Listener at localhost/41563] regionserver.HRegion(1071): Opened 3f073903d539e891926b9ef2e87fb6ee; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60424168, jitterRate=-0.09960973262786865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:40,382 DEBUG [Listener at localhost/41563] regionserver.HRegion(964): Region open journal for 3f073903d539e891926b9ef2e87fb6ee: 2023-02-19 08:00:40,390 DEBUG [Listener at localhost/41563] regionserver.HRegion(1603): Closing 3f073903d539e891926b9ef2e87fb6ee, disabling compactions & flushes 2023-02-19 08:00:40,390 INFO [Listener at localhost/41563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:40,391 DEBUG [Listener at localhost/41563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:40,391 DEBUG [Listener at localhost/41563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. after waiting 0 ms 2023-02-19 08:00:40,391 DEBUG [Listener at localhost/41563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:40,392 INFO [Listener at localhost/41563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:40,392 DEBUG [Listener at localhost/41563] regionserver.HRegion(1557): Region close journal for 3f073903d539e891926b9ef2e87fb6ee: 2023-02-19 08:00:40,392 DEBUG [Listener at localhost/41563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:40,393 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:40,394 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:40,396 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:40,396 DEBUG [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1 2023-02-19 08:00:40,397 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7cd120d9a6330ee2369b2dd340b063a3 columnFamilyName f1 2023-02-19 08:00:40,401 DEBUG [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/testWithMockedMapReduceMultiRegion=7cd120d9a6330ee2369b2dd340b063a3-d9b11bf23182450ea70fb0d872580f31 2023-02-19 08:00:40,401 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] regionserver.HStore(310): Store=7cd120d9a6330ee2369b2dd340b063a3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,401 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:40,402 DEBUG [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2 2023-02-19 08:00:40,403 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7cd120d9a6330ee2369b2dd340b063a3 columnFamilyName f2 2023-02-19 08:00:40,409 DEBUG [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/testWithMockedMapReduceMultiRegion=7cd120d9a6330ee2369b2dd340b063a3-e9aad53c32f048a0b924c6b6e8aa715b 2023-02-19 08:00:40,409 INFO [StoreOpener-7cd120d9a6330ee2369b2dd340b063a3-1] regionserver.HStore(310): Store=7cd120d9a6330ee2369b2dd340b063a3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,410 DEBUG [Listener at localhost/41563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:40,410 INFO [Listener at localhost/41563] regionserver.HRegion(1071): Opened 7cd120d9a6330ee2369b2dd340b063a3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61124242, jitterRate=-0.08917781710624695}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:40,410 DEBUG [Listener at localhost/41563] regionserver.HRegion(964): Region open journal for 7cd120d9a6330ee2369b2dd340b063a3: 2023-02-19 08:00:40,421 DEBUG [Listener at localhost/41563] regionserver.HRegion(1603): Closing 7cd120d9a6330ee2369b2dd340b063a3, disabling compactions & flushes 2023-02-19 08:00:40,421 INFO [Listener at localhost/41563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:40,421 DEBUG [Listener at localhost/41563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:40,421 DEBUG [Listener at localhost/41563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. after waiting 0 ms 2023-02-19 08:00:40,421 DEBUG [Listener at localhost/41563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:40,424 INFO [Listener at localhost/41563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:40,424 DEBUG [Listener at localhost/41563] regionserver.HRegion(1557): Region close journal for 7cd120d9a6330ee2369b2dd340b063a3: 2023-02-19 08:00:40,424 DEBUG [Listener at localhost/41563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:40,424 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:40,426 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:40,428 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:40,430 DEBUG [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/f1 2023-02-19 08:00:40,430 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92a06107ebec2862485dbcb7f2874d9d columnFamilyName f1 2023-02-19 08:00:40,431 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] regionserver.HStore(310): Store=92a06107ebec2862485dbcb7f2874d9d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,431 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:40,432 DEBUG [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/f2 2023-02-19 08:00:40,432 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92a06107ebec2862485dbcb7f2874d9d columnFamilyName f2 2023-02-19 08:00:40,433 INFO [StoreOpener-92a06107ebec2862485dbcb7f2874d9d-1] regionserver.HStore(310): Store=92a06107ebec2862485dbcb7f2874d9d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,433 DEBUG [Listener at localhost/41563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:40,433 INFO [Listener at localhost/41563] regionserver.HRegion(1071): Opened 92a06107ebec2862485dbcb7f2874d9d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65719313, jitterRate=-0.020705923438072205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:40,433 DEBUG [Listener at localhost/41563] regionserver.HRegion(964): Region open journal for 92a06107ebec2862485dbcb7f2874d9d: 2023-02-19 08:00:40,433 DEBUG [Listener at localhost/41563] regionserver.HRegion(1603): Closing 92a06107ebec2862485dbcb7f2874d9d, disabling compactions & flushes 2023-02-19 08:00:40,433 INFO [Listener at localhost/41563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:40,434 DEBUG [Listener at localhost/41563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:40,434 DEBUG [Listener at localhost/41563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. after waiting 0 ms 2023-02-19 08:00:40,434 DEBUG [Listener at localhost/41563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:40,434 INFO [Listener at localhost/41563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:40,434 DEBUG [Listener at localhost/41563] regionserver.HRegion(1557): Region close journal for 92a06107ebec2862485dbcb7f2874d9d: 2023-02-19 08:00:40,435 DEBUG [Listener at localhost/41563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:40,435 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:40,449 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:40,468 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:40,470 DEBUG [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1 2023-02-19 08:00:40,470 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a9428cd756e81c65eff8b60344624b8 columnFamilyName f1 2023-02-19 08:00:40,475 DEBUG [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/testWithMockedMapReduceMultiRegion=7a9428cd756e81c65eff8b60344624b8-a5c875c397c94f96885497821d6badd4 2023-02-19 08:00:40,476 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] regionserver.HStore(310): Store=7a9428cd756e81c65eff8b60344624b8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,476 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:40,476 DEBUG [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2 2023-02-19 08:00:40,477 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a9428cd756e81c65eff8b60344624b8 columnFamilyName f2 2023-02-19 08:00:40,480 DEBUG [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/testWithMockedMapReduceMultiRegion=7a9428cd756e81c65eff8b60344624b8-f34a966994ae4b87bff061c9fa230c2a 2023-02-19 08:00:40,480 INFO [StoreOpener-7a9428cd756e81c65eff8b60344624b8-1] regionserver.HStore(310): Store=7a9428cd756e81c65eff8b60344624b8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,481 DEBUG [Listener at localhost/41563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:40,481 INFO [Listener at localhost/41563] regionserver.HRegion(1071): Opened 7a9428cd756e81c65eff8b60344624b8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67060945, jitterRate=-7.140487432479858E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:40,481 DEBUG [Listener at localhost/41563] regionserver.HRegion(964): Region open journal for 7a9428cd756e81c65eff8b60344624b8: 2023-02-19 08:00:40,490 DEBUG [Listener at localhost/41563] regionserver.HRegion(1603): Closing 7a9428cd756e81c65eff8b60344624b8, disabling compactions & flushes 2023-02-19 08:00:40,491 INFO [Listener at localhost/41563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:40,491 DEBUG [Listener at localhost/41563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:40,491 DEBUG [Listener at localhost/41563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. after waiting 0 ms 2023-02-19 08:00:40,491 DEBUG [Listener at localhost/41563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:40,491 INFO [Listener at localhost/41563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:40,491 DEBUG [Listener at localhost/41563] regionserver.HRegion(1557): Region close journal for 7a9428cd756e81c65eff8b60344624b8: 2023-02-19 08:00:40,492 DEBUG [Listener at localhost/41563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:40,492 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:40,494 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:40,495 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:40,496 DEBUG [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/f1 2023-02-19 08:00:40,497 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a23407b898fabee7c34dfab313835fd1 columnFamilyName f1 2023-02-19 08:00:40,497 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] regionserver.HStore(310): Store=a23407b898fabee7c34dfab313835fd1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,497 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:40,498 DEBUG [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/f2 2023-02-19 08:00:40,498 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a23407b898fabee7c34dfab313835fd1 columnFamilyName f2 2023-02-19 08:00:40,499 INFO [StoreOpener-a23407b898fabee7c34dfab313835fd1-1] regionserver.HStore(310): Store=a23407b898fabee7c34dfab313835fd1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,499 DEBUG [Listener at localhost/41563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:40,499 INFO [Listener at localhost/41563] regionserver.HRegion(1071): Opened a23407b898fabee7c34dfab313835fd1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72936628, jitterRate=0.08684045076370239}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:40,499 DEBUG [Listener at localhost/41563] regionserver.HRegion(964): Region open journal for a23407b898fabee7c34dfab313835fd1: 2023-02-19 08:00:40,499 DEBUG [Listener at localhost/41563] regionserver.HRegion(1603): Closing a23407b898fabee7c34dfab313835fd1, disabling compactions & flushes 2023-02-19 08:00:40,499 INFO [Listener at localhost/41563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:40,499 DEBUG [Listener at localhost/41563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:40,499 DEBUG [Listener at localhost/41563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. after waiting 0 ms 2023-02-19 08:00:40,499 DEBUG [Listener at localhost/41563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:40,500 INFO [Listener at localhost/41563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:40,500 DEBUG [Listener at localhost/41563] regionserver.HRegion(1557): Region close journal for a23407b898fabee7c34dfab313835fd1: 2023-02-19 08:00:40,500 DEBUG [Listener at localhost/41563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:40,500 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:40,501 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:40,503 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:40,503 DEBUG [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1 2023-02-19 08:00:40,503 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43ef5036ff68800b16bea301e1b9c008 columnFamilyName f1 2023-02-19 08:00:40,507 DEBUG [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/testWithMockedMapReduceMultiRegion=43ef5036ff68800b16bea301e1b9c008-eb15731b539c46ac96fe6b1baf42c66b 2023-02-19 08:00:40,507 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] regionserver.HStore(310): Store=43ef5036ff68800b16bea301e1b9c008/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,507 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:40,507 DEBUG [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2 2023-02-19 08:00:40,508 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43ef5036ff68800b16bea301e1b9c008 columnFamilyName f2 2023-02-19 08:00:40,511 DEBUG [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/testWithMockedMapReduceMultiRegion=43ef5036ff68800b16bea301e1b9c008-5fa23b7821b64e2bba87492ed1e4a42e 2023-02-19 08:00:40,511 INFO [StoreOpener-43ef5036ff68800b16bea301e1b9c008-1] regionserver.HStore(310): Store=43ef5036ff68800b16bea301e1b9c008/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,511 DEBUG [Listener at localhost/41563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:40,511 INFO [Listener at localhost/41563] regionserver.HRegion(1071): Opened 43ef5036ff68800b16bea301e1b9c008; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60767452, jitterRate=-0.09449440240859985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:40,511 DEBUG [Listener at localhost/41563] regionserver.HRegion(964): Region open journal for 43ef5036ff68800b16bea301e1b9c008: 2023-02-19 08:00:40,519 DEBUG [Listener at localhost/41563] regionserver.HRegion(1603): Closing 43ef5036ff68800b16bea301e1b9c008, disabling compactions & flushes 2023-02-19 08:00:40,520 INFO [Listener at localhost/41563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:40,520 DEBUG [Listener at localhost/41563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:40,520 DEBUG [Listener at localhost/41563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. after waiting 0 ms 2023-02-19 08:00:40,520 DEBUG [Listener at localhost/41563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:40,520 INFO [Listener at localhost/41563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:40,521 DEBUG [Listener at localhost/41563] regionserver.HRegion(1557): Region close journal for 43ef5036ff68800b16bea301e1b9c008: 2023-02-19 08:00:40,521 DEBUG [Listener at localhost/41563] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:40,521 INFO [Listener at localhost/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:40,522 DEBUG [Listener at localhost/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:40,523 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:40,524 DEBUG [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1 2023-02-19 08:00:40,524 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5784037bf95e6150ae47bcf3f1ab95df columnFamilyName f1 2023-02-19 08:00:40,528 DEBUG [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/testWithMockedMapReduceMultiRegion=5784037bf95e6150ae47bcf3f1ab95df-f4c276c747f74f9c9c49e0efba672236 2023-02-19 08:00:40,528 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] regionserver.HStore(310): Store=5784037bf95e6150ae47bcf3f1ab95df/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,528 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:40,528 DEBUG [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2 2023-02-19 08:00:40,529 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5784037bf95e6150ae47bcf3f1ab95df columnFamilyName f2 2023-02-19 08:00:40,531 DEBUG [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] regionserver.HStore(539): loaded hdfs://localhost:40365/user/jenkins/test-data/87004355-df8c-0495-3a73-eb122e3132d5/testWithMockedMapReduceMultiRegion/b3c0734a-d06c-4c4d-94f8-2ff39a852a00/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/testWithMockedMapReduceMultiRegion=5784037bf95e6150ae47bcf3f1ab95df-0324c09d3d4c4d9ca4027841338fe864 2023-02-19 08:00:40,532 INFO [StoreOpener-5784037bf95e6150ae47bcf3f1ab95df-1] regionserver.HStore(310): Store=5784037bf95e6150ae47bcf3f1ab95df/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:40,532 DEBUG [Listener at localhost/41563] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:40,532 INFO [Listener at localhost/41563] regionserver.HRegion(1071): Opened 5784037bf95e6150ae47bcf3f1ab95df; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70446935, jitterRate=0.04974113404750824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:40,532 DEBUG [Listener at localhost/41563] regionserver.HRegion(964): Region open journal for 5784037bf95e6150ae47bcf3f1ab95df: 2023-02-19 08:00:40,540 DEBUG [Listener at localhost/41563] regionserver.HRegion(1603): Closing 5784037bf95e6150ae47bcf3f1ab95df, disabling compactions & flushes 2023-02-19 08:00:40,540 INFO [Listener at localhost/41563] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:40,540 DEBUG [Listener at localhost/41563] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:40,540 DEBUG [Listener at localhost/41563] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. after waiting 0 ms 2023-02-19 08:00:40,540 DEBUG [Listener at localhost/41563] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:40,541 INFO [Listener at localhost/41563] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:40,541 DEBUG [Listener at localhost/41563] regionserver.HRegion(1557): Region close journal for 5784037bf95e6150ae47bcf3f1ab95df: 2023-02-19 08:00:40,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-19 08:00:40,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-19 08:00:40,548 INFO [Listener at localhost/41563] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-19 08:00:40,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-19 08:00:40,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:40,552 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793640551"}]},"ts":"1676793640551"} 2023-02-19 08:00:40,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 08:00:40,553 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-19 08:00:40,554 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-19 08:00:40,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a06107ebec2862485dbcb7f2874d9d, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fa1f21598f651f89bf8b3beecc73a2c, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5784037bf95e6150ae47bcf3f1ab95df, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cd120d9a6330ee2369b2dd340b063a3, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f073903d539e891926b9ef2e87fb6ee, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=06c312aedf70a4991ddd0391628a8059, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=684e488c070809f4f5884fcdc0a1cbc6, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43ef5036ff68800b16bea301e1b9c008, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7a9428cd756e81c65eff8b60344624b8, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a23407b898fabee7c34dfab313835fd1, UNASSIGN}] 2023-02-19 08:00:40,556 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5784037bf95e6150ae47bcf3f1ab95df, UNASSIGN 2023-02-19 08:00:40,556 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fa1f21598f651f89bf8b3beecc73a2c, UNASSIGN 2023-02-19 08:00:40,556 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a06107ebec2862485dbcb7f2874d9d, UNASSIGN 2023-02-19 08:00:40,556 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cd120d9a6330ee2369b2dd340b063a3, UNASSIGN 2023-02-19 08:00:40,556 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a23407b898fabee7c34dfab313835fd1, UNASSIGN 2023-02-19 08:00:40,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=5784037bf95e6150ae47bcf3f1ab95df, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:40,557 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=2fa1f21598f651f89bf8b3beecc73a2c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:40,557 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793640557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793640557"}]},"ts":"1676793640557"} 2023-02-19 08:00:40,557 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=92a06107ebec2862485dbcb7f2874d9d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:40,557 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7cd120d9a6330ee2369b2dd340b063a3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:40,558 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676793640557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793640557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793640557"}]},"ts":"1676793640557"} 2023-02-19 08:00:40,558 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793640557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793640557"}]},"ts":"1676793640557"} 2023-02-19 08:00:40,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793640557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793640557"}]},"ts":"1676793640557"} 2023-02-19 08:00:40,557 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a23407b898fabee7c34dfab313835fd1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:40,558 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676793640557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793640557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793640557"}]},"ts":"1676793640557"} 2023-02-19 08:00:40,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure 5784037bf95e6150ae47bcf3f1ab95df, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:40,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=34, state=RUNNABLE; CloseRegionProcedure 92a06107ebec2862485dbcb7f2874d9d, server=jenkins-hbase4.apache.org,34875,1676793635749}] 2023-02-19 08:00:40,560 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 7cd120d9a6330ee2369b2dd340b063a3, server=jenkins-hbase4.apache.org,34875,1676793635749}] 2023-02-19 08:00:40,561 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure 2fa1f21598f651f89bf8b3beecc73a2c, server=jenkins-hbase4.apache.org,34875,1676793635749}] 2023-02-19 08:00:40,561 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure a23407b898fabee7c34dfab313835fd1, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:40,561 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7a9428cd756e81c65eff8b60344624b8, UNASSIGN 2023-02-19 08:00:40,562 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43ef5036ff68800b16bea301e1b9c008, UNASSIGN 2023-02-19 08:00:40,562 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7a9428cd756e81c65eff8b60344624b8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:40,562 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793640562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793640562"}]},"ts":"1676793640562"} 2023-02-19 08:00:40,562 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=43ef5036ff68800b16bea301e1b9c008, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:40,562 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793640562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793640562"}]},"ts":"1676793640562"} 2023-02-19 08:00:40,563 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=684e488c070809f4f5884fcdc0a1cbc6, UNASSIGN 2023-02-19 08:00:40,563 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=06c312aedf70a4991ddd0391628a8059, UNASSIGN 2023-02-19 08:00:40,563 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=684e488c070809f4f5884fcdc0a1cbc6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:40,563 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f073903d539e891926b9ef2e87fb6ee, UNASSIGN 2023-02-19 08:00:40,563 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793640563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793640563"}]},"ts":"1676793640563"} 2023-02-19 08:00:40,564 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=06c312aedf70a4991ddd0391628a8059, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:40,564 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640564"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793640564"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793640564"}]},"ts":"1676793640564"} 2023-02-19 08:00:40,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 7a9428cd756e81c65eff8b60344624b8, server=jenkins-hbase4.apache.org,34875,1676793635749}] 2023-02-19 08:00:40,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 43ef5036ff68800b16bea301e1b9c008, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:40,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 684e488c070809f4f5884fcdc0a1cbc6, server=jenkins-hbase4.apache.org,34875,1676793635749}] 2023-02-19 08:00:40,566 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3f073903d539e891926b9ef2e87fb6ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:40,566 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793640566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793640566"}]},"ts":"1676793640566"} 2023-02-19 08:00:40,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 06c312aedf70a4991ddd0391628a8059, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:40,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 3f073903d539e891926b9ef2e87fb6ee, server=jenkins-hbase4.apache.org,34119,1676793635698}] 2023-02-19 08:00:40,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 08:00:40,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:40,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 06c312aedf70a4991ddd0391628a8059, disabling compactions & flushes 2023-02-19 08:00:40,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:40,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:40,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. after waiting 0 ms 2023-02-19 08:00:40,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:40,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:40,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 684e488c070809f4f5884fcdc0a1cbc6, disabling compactions & flushes 2023-02-19 08:00:40,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:40,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:40,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. after waiting 0 ms 2023-02-19 08:00:40,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:40,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:40,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059. 2023-02-19 08:00:40,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 06c312aedf70a4991ddd0391628a8059: 2023-02-19 08:00:40,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:40,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6. 2023-02-19 08:00:40,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 684e488c070809f4f5884fcdc0a1cbc6: 2023-02-19 08:00:40,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:40,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:40,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5784037bf95e6150ae47bcf3f1ab95df, disabling compactions & flushes 2023-02-19 08:00:40,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:40,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:40,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. after waiting 0 ms 2023-02-19 08:00:40,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:40,726 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=06c312aedf70a4991ddd0391628a8059, regionState=CLOSED 2023-02-19 08:00:40,726 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640726"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793640726"}]},"ts":"1676793640726"} 2023-02-19 08:00:40,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:40,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:40,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7cd120d9a6330ee2369b2dd340b063a3, disabling compactions & flushes 2023-02-19 08:00:40,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:40,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:40,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. after waiting 0 ms 2023-02-19 08:00:40,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:40,727 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=684e488c070809f4f5884fcdc0a1cbc6, regionState=CLOSED 2023-02-19 08:00:40,727 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793640727"}]},"ts":"1676793640727"} 2023-02-19 08:00:40,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:40,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-19 08:00:40,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 06c312aedf70a4991ddd0391628a8059, server=jenkins-hbase4.apache.org,34119,1676793635698 in 161 msec 2023-02-19 08:00:40,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df. 2023-02-19 08:00:40,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5784037bf95e6150ae47bcf3f1ab95df: 2023-02-19 08:00:40,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-19 08:00:40,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 684e488c070809f4f5884fcdc0a1cbc6, server=jenkins-hbase4.apache.org,34875,1676793635749 in 163 msec 2023-02-19 08:00:40,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=06c312aedf70a4991ddd0391628a8059, UNASSIGN in 176 msec 2023-02-19 08:00:40,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=684e488c070809f4f5884fcdc0a1cbc6, UNASSIGN in 176 msec 2023-02-19 08:00:40,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:40,732 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=5784037bf95e6150ae47bcf3f1ab95df, regionState=CLOSED 2023-02-19 08:00:40,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:40,733 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793640732"}]},"ts":"1676793640732"} 2023-02-19 08:00:40,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:40,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a23407b898fabee7c34dfab313835fd1, disabling compactions & flushes 2023-02-19 08:00:40,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:40,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:40,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. after waiting 0 ms 2023-02-19 08:00:40,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:40,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3. 2023-02-19 08:00:40,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7cd120d9a6330ee2369b2dd340b063a3: 2023-02-19 08:00:40,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:40,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:40,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 92a06107ebec2862485dbcb7f2874d9d, disabling compactions & flushes 2023-02-19 08:00:40,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:40,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:40,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. after waiting 0 ms 2023-02-19 08:00:40,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:40,737 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7cd120d9a6330ee2369b2dd340b063a3, regionState=CLOSED 2023-02-19 08:00:40,737 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793640737"}]},"ts":"1676793640737"} 2023-02-19 08:00:40,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-19 08:00:40,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure 5784037bf95e6150ae47bcf3f1ab95df, server=jenkins-hbase4.apache.org,34119,1676793635698 in 175 msec 2023-02-19 08:00:40,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 08:00:40,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1. 2023-02-19 08:00:40,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a23407b898fabee7c34dfab313835fd1: 2023-02-19 08:00:40,739 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5784037bf95e6150ae47bcf3f1ab95df, UNASSIGN in 182 msec 2023-02-19 08:00:40,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:40,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:40,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3f073903d539e891926b9ef2e87fb6ee, disabling compactions & flushes 2023-02-19 08:00:40,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:40,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:40,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. after waiting 0 ms 2023-02-19 08:00:40,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:40,741 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a23407b898fabee7c34dfab313835fd1, regionState=CLOSED 2023-02-19 08:00:40,741 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676793640741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793640741"}]},"ts":"1676793640741"} 2023-02-19 08:00:40,741 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-19 08:00:40,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-19 08:00:40,741 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 7cd120d9a6330ee2369b2dd340b063a3, server=jenkins-hbase4.apache.org,34875,1676793635749 in 179 msec 2023-02-19 08:00:40,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d. 2023-02-19 08:00:40,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 92a06107ebec2862485dbcb7f2874d9d: 2023-02-19 08:00:40,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7cd120d9a6330ee2369b2dd340b063a3, UNASSIGN in 186 msec 2023-02-19 08:00:40,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:40,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:40,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2fa1f21598f651f89bf8b3beecc73a2c, disabling compactions & flushes 2023-02-19 08:00:40,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:40,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:40,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. after waiting 0 ms 2023-02-19 08:00:40,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:40,746 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=92a06107ebec2862485dbcb7f2874d9d, regionState=CLOSED 2023-02-19 08:00:40,746 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676793640746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793640746"}]},"ts":"1676793640746"} 2023-02-19 08:00:40,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:40,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-19 08:00:40,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure a23407b898fabee7c34dfab313835fd1, server=jenkins-hbase4.apache.org,34119,1676793635698 in 183 msec 2023-02-19 08:00:40,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee. 2023-02-19 08:00:40,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3f073903d539e891926b9ef2e87fb6ee: 2023-02-19 08:00:40,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a23407b898fabee7c34dfab313835fd1, UNASSIGN in 192 msec 2023-02-19 08:00:40,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:40,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:40,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 43ef5036ff68800b16bea301e1b9c008, disabling compactions & flushes 2023-02-19 08:00:40,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:40,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:40,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. after waiting 0 ms 2023-02-19 08:00:40,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:40,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=34 2023-02-19 08:00:40,749 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3f073903d539e891926b9ef2e87fb6ee, regionState=CLOSED 2023-02-19 08:00:40,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=34, state=SUCCESS; CloseRegionProcedure 92a06107ebec2862485dbcb7f2874d9d, server=jenkins-hbase4.apache.org,34875,1676793635749 in 188 msec 2023-02-19 08:00:40,749 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793640749"}]},"ts":"1676793640749"} 2023-02-19 08:00:40,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:40,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=92a06107ebec2862485dbcb7f2874d9d, UNASSIGN in 194 msec 2023-02-19 08:00:40,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c. 2023-02-19 08:00:40,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2fa1f21598f651f89bf8b3beecc73a2c: 2023-02-19 08:00:40,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:40,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:40,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7a9428cd756e81c65eff8b60344624b8, disabling compactions & flushes 2023-02-19 08:00:40,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:40,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:40,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. after waiting 0 ms 2023-02-19 08:00:40,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:40,754 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=2fa1f21598f651f89bf8b3beecc73a2c, regionState=CLOSED 2023-02-19 08:00:40,754 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640754"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793640754"}]},"ts":"1676793640754"} 2023-02-19 08:00:40,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-19 08:00:40,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 3f073903d539e891926b9ef2e87fb6ee, server=jenkins-hbase4.apache.org,34119,1676793635698 in 183 msec 2023-02-19 08:00:40,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f073903d539e891926b9ef2e87fb6ee, UNASSIGN in 200 msec 2023-02-19 08:00:40,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:40,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-19 08:00:40,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure 2fa1f21598f651f89bf8b3beecc73a2c, server=jenkins-hbase4.apache.org,34875,1676793635749 in 194 msec 2023-02-19 08:00:40,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008. 2023-02-19 08:00:40,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 43ef5036ff68800b16bea301e1b9c008: 2023-02-19 08:00:40,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2fa1f21598f651f89bf8b3beecc73a2c, UNASSIGN in 202 msec 2023-02-19 08:00:40,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:40,760 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=43ef5036ff68800b16bea301e1b9c008, regionState=CLOSED 2023-02-19 08:00:40,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:40,760 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640760"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793640760"}]},"ts":"1676793640760"} 2023-02-19 08:00:40,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8. 2023-02-19 08:00:40,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7a9428cd756e81c65eff8b60344624b8: 2023-02-19 08:00:40,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:40,762 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=7a9428cd756e81c65eff8b60344624b8, regionState=CLOSED 2023-02-19 08:00:40,762 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676793640762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793640762"}]},"ts":"1676793640762"} 2023-02-19 08:00:40,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-19 08:00:40,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 43ef5036ff68800b16bea301e1b9c008, server=jenkins-hbase4.apache.org,34119,1676793635698 in 196 msec 2023-02-19 08:00:40,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=43ef5036ff68800b16bea301e1b9c008, UNASSIGN in 208 msec 2023-02-19 08:00:40,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-19 08:00:40,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 7a9428cd756e81c65eff8b60344624b8, server=jenkins-hbase4.apache.org,34875,1676793635749 in 199 msec 2023-02-19 08:00:40,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=33 2023-02-19 08:00:40,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7a9428cd756e81c65eff8b60344624b8, UNASSIGN in 210 msec 2023-02-19 08:00:40,766 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793640766"}]},"ts":"1676793640766"} 2023-02-19 08:00:40,767 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-19 08:00:40,822 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-19 08:00:40,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 274 msec 2023-02-19 08:00:40,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-19 08:00:40,855 INFO [Listener at localhost/41563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-19 08:00:40,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-19 08:00:40,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:40,858 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:40,858 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:40,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 08:00:40,868 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:40,868 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:40,868 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:40,868 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:40,868 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:40,868 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:40,868 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:40,868 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:40,871 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/recovered.edits] 2023-02-19 08:00:40,871 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/f1, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/f2, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/recovered.edits] 2023-02-19 08:00:40,872 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/recovered.edits] 2023-02-19 08:00:40,872 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/recovered.edits] 2023-02-19 08:00:40,872 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/recovered.edits] 2023-02-19 08:00:40,873 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/recovered.edits] 2023-02-19 08:00:40,873 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/recovered.edits] 2023-02-19 08:00:40,873 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/recovered.edits] 2023-02-19 08:00:40,881 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/d07edd1be1e1494296a683b8ef712af0 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/d07edd1be1e1494296a683b8ef712af0 2023-02-19 08:00:40,881 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/57436b020a9a41d196faa4477eab14ca to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/57436b020a9a41d196faa4477eab14ca 2023-02-19 08:00:40,881 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/43b2b2efd8814209a3afb51e264d8953 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/43b2b2efd8814209a3afb51e264d8953 2023-02-19 08:00:40,882 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/4510b8b602c74018a1bbdc82104c655b to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/4510b8b602c74018a1bbdc82104c655b 2023-02-19 08:00:40,882 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/01c565c27d7b44daa472bdf90784e0ba to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/01c565c27d7b44daa472bdf90784e0ba 2023-02-19 08:00:40,883 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/278911e33c72411689d3cc659bfa296c to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/278911e33c72411689d3cc659bfa296c 2023-02-19 08:00:40,883 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/27555e80be9f4f3cba572538dd341dfb to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/27555e80be9f4f3cba572538dd341dfb 2023-02-19 08:00:40,883 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/f4c276c747f74f9c9c49e0efba672236 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f1/f4c276c747f74f9c9c49e0efba672236 2023-02-19 08:00:40,884 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/f4786bdeabbc439db3f6a512dd506f0c to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f1/f4786bdeabbc439db3f6a512dd506f0c 2023-02-19 08:00:40,884 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/d9b11bf23182450ea70fb0d872580f31 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f1/d9b11bf23182450ea70fb0d872580f31 2023-02-19 08:00:40,884 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/5b413c241ecd4a9fa5dda32b32e5ce10 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f1/5b413c241ecd4a9fa5dda32b32e5ce10 2023-02-19 08:00:40,885 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/recovered.edits/6.seqid to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d/recovered.edits/6.seqid 2023-02-19 08:00:40,885 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/6e5d7ae80d1747f782ff87df759e1b65 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f1/6e5d7ae80d1747f782ff87df759e1b65 2023-02-19 08:00:40,885 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/c516ee87e8ea4cec89a1b645ca9bb139 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f1/c516ee87e8ea4cec89a1b645ca9bb139 2023-02-19 08:00:40,886 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/92a06107ebec2862485dbcb7f2874d9d 2023-02-19 08:00:40,886 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:40,886 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/eb15731b539c46ac96fe6b1baf42c66b to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f1/eb15731b539c46ac96fe6b1baf42c66b 2023-02-19 08:00:40,887 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/0324c09d3d4c4d9ca4027841338fe864 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/0324c09d3d4c4d9ca4027841338fe864 2023-02-19 08:00:40,889 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/recovered.edits] 2023-02-19 08:00:40,890 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/0f40d0e1365d4d02b6f776322344a27f to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/f2/0f40d0e1365d4d02b6f776322344a27f 2023-02-19 08:00:40,890 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/6d7d0235fa6f45c596a552359ddaa60b to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/6d7d0235fa6f45c596a552359ddaa60b 2023-02-19 08:00:40,890 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/069e992bb1cb4861981f0002291fe1ec to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/069e992bb1cb4861981f0002291fe1ec 2023-02-19 08:00:40,890 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/a702c8fc15c842a28742b2d372fc2040 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/a702c8fc15c842a28742b2d372fc2040 2023-02-19 08:00:40,891 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/1721025f74f74a858efc6f6d653f69c5 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/1721025f74f74a858efc6f6d653f69c5 2023-02-19 08:00:40,891 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/139f258bfc8140c6b9e9912e5c7e4269 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/139f258bfc8140c6b9e9912e5c7e4269 2023-02-19 08:00:40,891 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/5fa23b7821b64e2bba87492ed1e4a42e to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/5fa23b7821b64e2bba87492ed1e4a42e 2023-02-19 08:00:40,899 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/b95aa65500494fc7abcad8a6bf551eb8 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/f2/b95aa65500494fc7abcad8a6bf551eb8 2023-02-19 08:00:40,899 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/1830106049e04eb0bbfbe75b4237c717 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/f2/1830106049e04eb0bbfbe75b4237c717 2023-02-19 08:00:40,899 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/af06512279c84f1295500ae0d43e3311 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/f2/af06512279c84f1295500ae0d43e3311 2023-02-19 08:00:40,899 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/2ea12fa2380a42d0952f941047988e7d to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/f2/2ea12fa2380a42d0952f941047988e7d 2023-02-19 08:00:40,899 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/e9aad53c32f048a0b924c6b6e8aa715b to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/f2/e9aad53c32f048a0b924c6b6e8aa715b 2023-02-19 08:00:40,899 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/6b27fe4b5e414729b31995e1e32e6b29 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/f2/6b27fe4b5e414729b31995e1e32e6b29 2023-02-19 08:00:40,902 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/718236e06eb847a1b175ea7bdf07b824 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/718236e06eb847a1b175ea7bdf07b824 2023-02-19 08:00:40,902 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/recovered.edits/12.seqid to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df/recovered.edits/12.seqid 2023-02-19 08:00:40,903 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/5784037bf95e6150ae47bcf3f1ab95df 2023-02-19 08:00:40,903 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:40,905 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/a5c875c397c94f96885497821d6badd4 to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f1/a5c875c397c94f96885497821d6badd4 2023-02-19 08:00:40,905 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/recovered.edits/12.seqid to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008/recovered.edits/12.seqid 2023-02-19 08:00:40,905 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/recovered.edits/12.seqid to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee/recovered.edits/12.seqid 2023-02-19 08:00:40,907 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f073903d539e891926b9ef2e87fb6ee 2023-02-19 08:00:40,907 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/recovered.edits/12.seqid to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6/recovered.edits/12.seqid 2023-02-19 08:00:40,907 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/43ef5036ff68800b16bea301e1b9c008 2023-02-19 08:00:40,907 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/recovered.edits/12.seqid to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c/recovered.edits/12.seqid 2023-02-19 08:00:40,908 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/684e488c070809f4f5884fcdc0a1cbc6 2023-02-19 08:00:40,908 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/f1, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/f2, FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/recovered.edits] 2023-02-19 08:00:40,908 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/recovered.edits/12.seqid to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3/recovered.edits/12.seqid 2023-02-19 08:00:40,908 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2fa1f21598f651f89bf8b3beecc73a2c 2023-02-19 08:00:40,909 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/recovered.edits/12.seqid to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059/recovered.edits/12.seqid 2023-02-19 08:00:40,910 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7cd120d9a6330ee2369b2dd340b063a3 2023-02-19 08:00:40,910 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/06c312aedf70a4991ddd0391628a8059 2023-02-19 08:00:40,911 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/e4ac392929d34bfdbdf4cda5f1b4a6db to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/e4ac392929d34bfdbdf4cda5f1b4a6db 2023-02-19 08:00:40,912 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/f34a966994ae4b87bff061c9fa230c2a to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/f2/f34a966994ae4b87bff061c9fa230c2a 2023-02-19 08:00:40,914 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/recovered.edits/6.seqid to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1/recovered.edits/6.seqid 2023-02-19 08:00:40,914 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/a23407b898fabee7c34dfab313835fd1 2023-02-19 08:00:40,915 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/recovered.edits/12.seqid to hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/archive/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8/recovered.edits/12.seqid 2023-02-19 08:00:40,916 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7a9428cd756e81c65eff8b60344624b8 2023-02-19 08:00:40,916 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-19 08:00:40,918 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:40,921 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-19 08:00:40,923 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-19 08:00:40,924 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:40,924 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-19 08:00:40,924 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793640924"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793640924"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793640924"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793640924"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793640924"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793640924"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793640924"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793640924"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793640924"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793640924"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,926 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-19 08:00:40,927 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 92a06107ebec2862485dbcb7f2874d9d, NAME => 'testWithMockedMapReduceMultiRegion,,1676793636790.92a06107ebec2862485dbcb7f2874d9d.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 2fa1f21598f651f89bf8b3beecc73a2c, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676793636790.2fa1f21598f651f89bf8b3beecc73a2c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 5784037bf95e6150ae47bcf3f1ab95df, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676793636790.5784037bf95e6150ae47bcf3f1ab95df.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 7cd120d9a6330ee2369b2dd340b063a3, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676793636790.7cd120d9a6330ee2369b2dd340b063a3.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 3f073903d539e891926b9ef2e87fb6ee, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676793636790.3f073903d539e891926b9ef2e87fb6ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 06c312aedf70a4991ddd0391628a8059, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676793636790.06c312aedf70a4991ddd0391628a8059.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 684e488c070809f4f5884fcdc0a1cbc6, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676793636790.684e488c070809f4f5884fcdc0a1cbc6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 43ef5036ff68800b16bea301e1b9c008, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676793636790.43ef5036ff68800b16bea301e1b9c008.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 7a9428cd756e81c65eff8b60344624b8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676793636790.7a9428cd756e81c65eff8b60344624b8.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => a23407b898fabee7c34dfab313835fd1, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676793636790.a23407b898fabee7c34dfab313835fd1.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-19 08:00:40,927 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-19 08:00:40,927 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676793640927"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:40,928 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-19 08:00:40,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 08:00:41,008 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-19 08:00:41,009 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 152 msec 2023-02-19 08:00:41,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39791] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-19 08:00:41,162 INFO [Listener at localhost/41563] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-19 08:00:41,162 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 08:00:41,162 INFO [Listener at localhost/41563] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 08:00:41,162 DEBUG [Listener at localhost/41563] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34c09d85 to 127.0.0.1:57105 2023-02-19 08:00:41,162 DEBUG [Listener at localhost/41563] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:41,162 DEBUG [Listener at localhost/41563] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 08:00:41,162 DEBUG [Listener at localhost/41563] util.JVMClusterUtil(257): Found active master hash=445994877, stopped=false 2023-02-19 08:00:41,162 INFO [Listener at localhost/41563] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39791,1676793635299 2023-02-19 08:00:41,306 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:41,307 INFO [Listener at localhost/41563] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 08:00:41,306 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:41,307 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:41,306 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:41,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:41,309 DEBUG [Listener at localhost/41563] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x655d262d to 127.0.0.1:57105 2023-02-19 08:00:41,309 DEBUG [Listener at localhost/41563] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:41,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:41,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:41,309 INFO [Listener at localhost/41563] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34119,1676793635698' ***** 2023-02-19 08:00:41,310 INFO [Listener at localhost/41563] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:41,310 INFO [Listener at localhost/41563] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34875,1676793635749' ***** 2023-02-19 08:00:41,310 INFO [Listener at localhost/41563] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:41,310 INFO [RS:0;jenkins-hbase4:34119] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:41,310 INFO [RS:0;jenkins-hbase4:34119] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:41,310 INFO [RS:1;jenkins-hbase4:34875] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:41,310 INFO [RS:0;jenkins-hbase4:34119] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:41,310 INFO [RS:1;jenkins-hbase4:34875] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:41,310 INFO [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(3304): Received CLOSE for 5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:41,310 INFO [RS:1;jenkins-hbase4:34875] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:41,310 INFO [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:41,310 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:41,310 DEBUG [RS:0;jenkins-hbase4:34119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5223ffbc to 127.0.0.1:57105 2023-02-19 08:00:41,310 INFO [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:41,310 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:41,311 DEBUG [RS:1;jenkins-hbase4:34875] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x339923f3 to 127.0.0.1:57105 2023-02-19 08:00:41,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5c5d0ced748dfe08157ece5a212c900e, disabling compactions & flushes 2023-02-19 08:00:41,313 DEBUG [RS:1;jenkins-hbase4:34875] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:41,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:41,311 DEBUG [RS:0;jenkins-hbase4:34119] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:41,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:41,313 INFO [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34875,1676793635749; all regions closed. 2023-02-19 08:00:41,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. after waiting 0 ms 2023-02-19 08:00:41,313 INFO [RS:0;jenkins-hbase4:34119] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:41,313 INFO [RS:0;jenkins-hbase4:34119] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:41,313 INFO [RS:0;jenkins-hbase4:34119] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:41,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:41,313 INFO [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 08:00:41,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 5c5d0ced748dfe08157ece5a212c900e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 08:00:41,313 INFO [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-19 08:00:41,313 DEBUG [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1479): Online Regions={5c5d0ced748dfe08157ece5a212c900e=hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e., 1588230740=hbase:meta,,1.1588230740} 2023-02-19 08:00:41,313 DEBUG [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1505): Waiting on 1588230740, 5c5d0ced748dfe08157ece5a212c900e 2023-02-19 08:00:41,315 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:41,316 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:41,316 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:41,316 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:41,316 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:41,316 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-19 08:00:41,319 DEBUG [RS:1;jenkins-hbase4:34875] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/oldWALs 2023-02-19 08:00:41,319 INFO [RS:1;jenkins-hbase4:34875] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34875%2C1676793635749:(num 1676793637060) 2023-02-19 08:00:41,319 DEBUG [RS:1;jenkins-hbase4:34875] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:41,319 INFO [RS:1;jenkins-hbase4:34875] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:41,320 INFO [RS:1;jenkins-hbase4:34875] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:41,320 INFO [RS:1;jenkins-hbase4:34875] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:41,320 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:41,320 INFO [RS:1;jenkins-hbase4:34875] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:41,320 INFO [RS:1;jenkins-hbase4:34875] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:41,321 INFO [RS:1;jenkins-hbase4:34875] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34875 2023-02-19 08:00:41,328 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/.tmp/info/aa8178a49df546c2a0f2c01683fa1fe2 2023-02-19 08:00:41,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e/.tmp/info/4006f0de7673483199fea6057a238c79 2023-02-19 08:00:41,332 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa8178a49df546c2a0f2c01683fa1fe2 2023-02-19 08:00:41,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e/.tmp/info/4006f0de7673483199fea6057a238c79 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e/info/4006f0de7673483199fea6057a238c79 2023-02-19 08:00:41,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e/info/4006f0de7673483199fea6057a238c79, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 08:00:41,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5c5d0ced748dfe08157ece5a212c900e in 24ms, sequenceid=6, compaction requested=false 2023-02-19 08:00:41,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/.tmp/rep_barrier/0184878972ce4c958d0959cfc93a0237 2023-02-19 08:00:41,341 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:41,341 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:41,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/namespace/5c5d0ced748dfe08157ece5a212c900e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 08:00:41,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:41,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5c5d0ced748dfe08157ece5a212c900e: 2023-02-19 08:00:41,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676793636326.5c5d0ced748dfe08157ece5a212c900e. 2023-02-19 08:00:41,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0184878972ce4c958d0959cfc93a0237 2023-02-19 08:00:41,353 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/.tmp/table/917ca27af5be4892af2fbea17c156c81 2023-02-19 08:00:41,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 917ca27af5be4892af2fbea17c156c81 2023-02-19 08:00:41,357 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/.tmp/info/aa8178a49df546c2a0f2c01683fa1fe2 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/info/aa8178a49df546c2a0f2c01683fa1fe2 2023-02-19 08:00:41,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa8178a49df546c2a0f2c01683fa1fe2 2023-02-19 08:00:41,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/info/aa8178a49df546c2a0f2c01683fa1fe2, entries=30, sequenceid=57, filesize=8.3 K 2023-02-19 08:00:41,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/.tmp/rep_barrier/0184878972ce4c958d0959cfc93a0237 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/rep_barrier/0184878972ce4c958d0959cfc93a0237 2023-02-19 08:00:41,365 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0184878972ce4c958d0959cfc93a0237 2023-02-19 08:00:41,365 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/rep_barrier/0184878972ce4c958d0959cfc93a0237, entries=10, sequenceid=57, filesize=6.1 K 2023-02-19 08:00:41,366 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/.tmp/table/917ca27af5be4892af2fbea17c156c81 as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/table/917ca27af5be4892af2fbea17c156c81 2023-02-19 08:00:41,369 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 917ca27af5be4892af2fbea17c156c81 2023-02-19 08:00:41,369 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/table/917ca27af5be4892af2fbea17c156c81, entries=13, sequenceid=57, filesize=6.1 K 2023-02-19 08:00:41,370 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=57, compaction requested=false 2023-02-19 08:00:41,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-19 08:00:41,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 08:00:41,375 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:41,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:41,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:41,430 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:41,430 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:41,430 ERROR [Listener at localhost/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31056a0f rejected from java.util.concurrent.ThreadPoolExecutor@353ae8f7[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:41,430 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:41,430 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34875,1676793635749 2023-02-19 08:00:41,430 ERROR [Listener at localhost/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b4d0b0f rejected from java.util.concurrent.ThreadPoolExecutor@353ae8f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:41,430 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:41,491 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34875,1676793635749] 2023-02-19 08:00:41,491 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34875,1676793635749; numProcessing=1 2023-02-19 08:00:41,516 INFO [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34119,1676793635698; all regions closed. 2023-02-19 08:00:41,522 DEBUG [RS:0;jenkins-hbase4:34119] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/oldWALs 2023-02-19 08:00:41,522 INFO [RS:0;jenkins-hbase4:34119] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34119%2C1676793635698.meta:.meta(num 1676793636266) 2023-02-19 08:00:41,527 DEBUG [RS:0;jenkins-hbase4:34119] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/oldWALs 2023-02-19 08:00:41,527 INFO [RS:0;jenkins-hbase4:34119] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34119%2C1676793635698:(num 1676793636693) 2023-02-19 08:00:41,527 DEBUG [RS:0;jenkins-hbase4:34119] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:41,527 INFO [RS:0;jenkins-hbase4:34119] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:41,528 INFO [RS:0;jenkins-hbase4:34119] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:41,528 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:41,529 INFO [RS:0;jenkins-hbase4:34119] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34119 2023-02-19 08:00:41,583 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34875,1676793635749 already deleted, retry=false 2023-02-19 08:00:41,583 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34875,1676793635749 expired; onlineServers=1 2023-02-19 08:00:41,662 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:41,662 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34119,1676793635698 2023-02-19 08:00:41,662 ERROR [Listener at localhost/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b895684 rejected from java.util.concurrent.ThreadPoolExecutor@7fb6cd2d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:41,730 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34119,1676793635698] 2023-02-19 08:00:41,730 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34119,1676793635698; numProcessing=2 2023-02-19 08:00:41,770 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:41,770 INFO [RS:1;jenkins-hbase4:34875] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34875,1676793635749; zookeeper connection closed. 2023-02-19 08:00:41,770 ERROR [Listener at localhost/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@239d62fc rejected from java.util.concurrent.ThreadPoolExecutor@353ae8f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:41,770 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34875-0x1006b984b8f0002, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:41,770 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@46d031f8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@46d031f8 2023-02-19 08:00:41,770 ERROR [Listener at localhost/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@23b1eb05 rejected from java.util.concurrent.ThreadPoolExecutor@353ae8f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:41,783 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34119,1676793635698 already deleted, retry=false 2023-02-19 08:00:41,783 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34119,1676793635698 expired; onlineServers=0 2023-02-19 08:00:41,783 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39791,1676793635299' ***** 2023-02-19 08:00:41,783 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 08:00:41,784 DEBUG [M:0;jenkins-hbase4:39791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eaad0f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:41,785 INFO [M:0;jenkins-hbase4:39791] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39791,1676793635299 2023-02-19 08:00:41,785 INFO [M:0;jenkins-hbase4:39791] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39791,1676793635299; all regions closed. 2023-02-19 08:00:41,785 DEBUG [M:0;jenkins-hbase4:39791] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:41,785 DEBUG [M:0;jenkins-hbase4:39791] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 08:00:41,785 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 08:00:41,785 DEBUG [M:0;jenkins-hbase4:39791] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 08:00:41,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793635914] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793635914,5,FailOnTimeoutGroup] 2023-02-19 08:00:41,785 INFO [M:0;jenkins-hbase4:39791] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 08:00:41,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793635914] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793635914,5,FailOnTimeoutGroup] 2023-02-19 08:00:41,786 INFO [M:0;jenkins-hbase4:39791] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 08:00:41,786 INFO [M:0;jenkins-hbase4:39791] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 08:00:41,786 DEBUG [M:0;jenkins-hbase4:39791] master.HMaster(1512): Stopping service threads 2023-02-19 08:00:41,786 INFO [M:0;jenkins-hbase4:39791] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 08:00:41,787 ERROR [M:0;jenkins-hbase4:39791] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 08:00:41,787 INFO [M:0;jenkins-hbase4:39791] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 08:00:41,787 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 08:00:41,814 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:41,814 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:41,814 DEBUG [M:0;jenkins-hbase4:39791] zookeeper.ZKUtil(398): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 08:00:41,814 WARN [M:0;jenkins-hbase4:39791] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 08:00:41,814 INFO [M:0;jenkins-hbase4:39791] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 08:00:41,815 INFO [M:0;jenkins-hbase4:39791] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 08:00:41,815 DEBUG [M:0;jenkins-hbase4:39791] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:41,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:41,815 INFO [M:0;jenkins-hbase4:39791] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:41,815 DEBUG [M:0;jenkins-hbase4:39791] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:41,815 DEBUG [M:0;jenkins-hbase4:39791] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:41,815 DEBUG [M:0;jenkins-hbase4:39791] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:41,815 INFO [M:0;jenkins-hbase4:39791] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.12 KB heapSize=200.04 KB 2023-02-19 08:00:41,824 INFO [M:0;jenkins-hbase4:39791] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.12 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0b157bbfc2974c68a723025e8c7001da 2023-02-19 08:00:41,828 DEBUG [M:0;jenkins-hbase4:39791] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0b157bbfc2974c68a723025e8c7001da as hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0b157bbfc2974c68a723025e8c7001da 2023-02-19 08:00:41,831 INFO [M:0;jenkins-hbase4:39791] regionserver.HStore(1080): Added hdfs://localhost:40365/user/jenkins/test-data/6395df4b-d007-6f9f-bdef-01283b3b288e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0b157bbfc2974c68a723025e8c7001da, entries=53, sequenceid=357, filesize=10.7 K 2023-02-19 08:00:41,832 INFO [M:0;jenkins-hbase4:39791] regionserver.HRegion(2947): Finished flush of dataSize ~167.12 KB/171134, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false 2023-02-19 08:00:41,832 INFO [M:0;jenkins-hbase4:39791] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:41,832 DEBUG [M:0;jenkins-hbase4:39791] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:41,834 INFO [M:0;jenkins-hbase4:39791] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 08:00:41,834 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:41,835 INFO [M:0;jenkins-hbase4:39791] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39791 2023-02-19 08:00:41,870 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:41,870 INFO [RS:0;jenkins-hbase4:34119] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34119,1676793635698; zookeeper connection closed. 2023-02-19 08:00:41,870 ERROR [Listener at localhost/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ac879fa rejected from java.util.concurrent.ThreadPoolExecutor@7fb6cd2d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:41,871 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:34119-0x1006b984b8f0001, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:41,871 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@62641e3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@62641e3 2023-02-19 08:00:41,871 ERROR [Listener at localhost/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@42d25eb1 rejected from java.util.concurrent.ThreadPoolExecutor@7fb6cd2d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:41,871 INFO [Listener at localhost/41563] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 08:00:41,945 DEBUG [M:0;jenkins-hbase4:39791] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39791,1676793635299 already deleted, retry=false 2023-02-19 08:00:42,170 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:42,170 INFO [M:0;jenkins-hbase4:39791] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39791,1676793635299; zookeeper connection closed. 2023-02-19 08:00:42,170 ERROR [Listener at localhost/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@51b66285 rejected from java.util.concurrent.ThreadPoolExecutor@5589ec6b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:42,171 DEBUG [Listener at localhost/41563-EventThread] zookeeper.ZKWatcher(600): master:39791-0x1006b984b8f0000, quorum=127.0.0.1:57105, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:42,171 ERROR [Listener at localhost/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43917ceb rejected from java.util.concurrent.ThreadPoolExecutor@5589ec6b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:42,171 WARN [Listener at localhost/41563] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:42,189 INFO [Listener at localhost/41563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:42,293 WARN [BP-1551718984-172.31.14.131-1676793634703 heartbeating to localhost/127.0.0.1:40365] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:42,296 WARN [BP-1551718984-172.31.14.131-1676793634703 heartbeating to localhost/127.0.0.1:40365] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1551718984-172.31.14.131-1676793634703 (Datanode Uuid 304de51b-e568-4e2b-a7fd-37c4a24344b5) service to localhost/127.0.0.1:40365 2023-02-19 08:00:42,297 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/cluster_5ddcc1d0-a92e-5449-56a2-fdc1296d720b/dfs/data/data3/current/BP-1551718984-172.31.14.131-1676793634703] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:42,298 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/cluster_5ddcc1d0-a92e-5449-56a2-fdc1296d720b/dfs/data/data4/current/BP-1551718984-172.31.14.131-1676793634703] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:42,299 WARN [Listener at localhost/41563] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:42,302 INFO [Listener at localhost/41563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:42,415 WARN [BP-1551718984-172.31.14.131-1676793634703 heartbeating to localhost/127.0.0.1:40365] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:42,415 WARN [BP-1551718984-172.31.14.131-1676793634703 heartbeating to localhost/127.0.0.1:40365] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1551718984-172.31.14.131-1676793634703 (Datanode Uuid 3f33c371-7cf1-46a9-aecf-464c97df7335) service to localhost/127.0.0.1:40365 2023-02-19 08:00:42,416 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/cluster_5ddcc1d0-a92e-5449-56a2-fdc1296d720b/dfs/data/data1/current/BP-1551718984-172.31.14.131-1676793634703] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:42,416 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/cluster_5ddcc1d0-a92e-5449-56a2-fdc1296d720b/dfs/data/data2/current/BP-1551718984-172.31.14.131-1676793634703] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:42,426 INFO [Listener at localhost/41563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:42,547 INFO [Listener at localhost/41563] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 08:00:42,595 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 08:00:42,612 INFO [Listener at localhost/41563] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 179) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39791,1676793635299)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:40365 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:40365 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:40365 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/41563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41563 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40365 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:40365 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41563.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:40365 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:40365 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=637 (was 568) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=381 (was 405), ProcessCount=170 (was 170), AvailableMemoryMB=9173 (was 9315) 2023-02-19 08:00:42,624 INFO [Listener at localhost/41563] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=381, ProcessCount=170, AvailableMemoryMB=9173 2023-02-19 08:00:42,635 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/hadoop.log.dir so I do NOT create it in target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c 2023-02-19 08:00:42,635 WARN [Listener at localhost/41563] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 08:00:42,635 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/hadoop.tmp.dir so I do NOT create it in target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c 2023-02-19 08:00:42,635 WARN [Listener at localhost/41563] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71508dc3-5501-7b28-b740-bfe8c43cef4a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 08:00:42,635 DEBUG [Listener at localhost/41563] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c 2023-02-19 08:00:42,635 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 08:00:42,635 INFO [Listener at localhost/41563] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/cluster_97522d0d-516b-9cba-d02d-426c55acf997, deleteOnExit=true 2023-02-19 08:00:42,635 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 08:00:42,636 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/test.cache.data in system properties and HBase conf 2023-02-19 08:00:42,636 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 08:00:42,636 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/hadoop.log.dir in system properties and HBase conf 2023-02-19 08:00:42,636 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 08:00:42,636 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 08:00:42,636 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 08:00:42,636 DEBUG [Listener at localhost/41563] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 08:00:42,636 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:42,636 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:42,636 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/nfs.dump.dir in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/java.io.tmpdir in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 08:00:42,637 INFO [Listener at localhost/41563] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 08:00:42,642 WARN [Listener at localhost/41563] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:42,642 WARN [Listener at localhost/41563] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:43,088 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 08:00:43,140 WARN [Listener at localhost/41563] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:43,142 INFO [Listener at localhost/41563] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:43,147 INFO [Listener at localhost/41563] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/java.io.tmpdir/Jetty_localhost_36573_hdfs____eah1ko/webapp 2023-02-19 08:00:43,240 INFO [Listener at localhost/41563] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36573 2023-02-19 08:00:43,245 WARN [Listener at localhost/41563] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:43,245 WARN [Listener at localhost/41563] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:43,283 WARN [Listener at localhost/35565] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:43,294 WARN [Listener at localhost/35565] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:43,296 WARN [Listener at localhost/35565] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:43,297 INFO [Listener at localhost/35565] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:43,302 INFO [Listener at localhost/35565] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/java.io.tmpdir/Jetty_localhost_40245_datanode____5aqd26/webapp 2023-02-19 08:00:43,402 INFO [Listener at localhost/35565] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40245 2023-02-19 08:00:43,412 WARN [Listener at localhost/33091] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:43,425 WARN [Listener at localhost/33091] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:43,427 WARN [Listener at localhost/33091] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:43,428 INFO [Listener at localhost/33091] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:43,431 INFO [Listener at localhost/33091] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/java.io.tmpdir/Jetty_localhost_44781_datanode____b4bn4n/webapp 2023-02-19 08:00:43,515 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ceabf0cd3c68ef0: Processing first storage report for DS-b389560f-8383-4925-abe3-845150674f5f from datanode 2687e268-43e2-4935-a181-e3e6972dd593 2023-02-19 08:00:43,516 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ceabf0cd3c68ef0: from storage DS-b389560f-8383-4925-abe3-845150674f5f node DatanodeRegistration(127.0.0.1:37031, datanodeUuid=2687e268-43e2-4935-a181-e3e6972dd593, infoPort=43523, infoSecurePort=0, ipcPort=33091, storageInfo=lv=-57;cid=testClusterID;nsid=293199351;c=1676793642684), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:43,516 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ceabf0cd3c68ef0: Processing first storage report for DS-67cde625-a25e-4a4c-8def-135535827a6f from datanode 2687e268-43e2-4935-a181-e3e6972dd593 2023-02-19 08:00:43,516 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ceabf0cd3c68ef0: from storage DS-67cde625-a25e-4a4c-8def-135535827a6f node DatanodeRegistration(127.0.0.1:37031, datanodeUuid=2687e268-43e2-4935-a181-e3e6972dd593, infoPort=43523, infoSecurePort=0, ipcPort=33091, storageInfo=lv=-57;cid=testClusterID;nsid=293199351;c=1676793642684), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:43,543 INFO [Listener at localhost/33091] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44781 2023-02-19 08:00:43,550 WARN [Listener at localhost/46631] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:43,658 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf9ec3d20f497b80b: Processing first storage report for DS-9a944b36-e3da-4100-8ca6-a3b554cb929e from datanode 5ae67b89-4fcc-4498-a7b9-d23d0d83c236 2023-02-19 08:00:43,658 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf9ec3d20f497b80b: from storage DS-9a944b36-e3da-4100-8ca6-a3b554cb929e node DatanodeRegistration(127.0.0.1:44005, datanodeUuid=5ae67b89-4fcc-4498-a7b9-d23d0d83c236, infoPort=40261, infoSecurePort=0, ipcPort=46631, storageInfo=lv=-57;cid=testClusterID;nsid=293199351;c=1676793642684), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:43,659 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf9ec3d20f497b80b: Processing first storage report for DS-941a7ce8-195f-4601-9578-58fa0844e6e9 from datanode 5ae67b89-4fcc-4498-a7b9-d23d0d83c236 2023-02-19 08:00:43,659 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf9ec3d20f497b80b: from storage DS-941a7ce8-195f-4601-9578-58fa0844e6e9 node DatanodeRegistration(127.0.0.1:44005, datanodeUuid=5ae67b89-4fcc-4498-a7b9-d23d0d83c236, infoPort=40261, infoSecurePort=0, ipcPort=46631, storageInfo=lv=-57;cid=testClusterID;nsid=293199351;c=1676793642684), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-19 08:00:43,760 DEBUG [Listener at localhost/46631] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c 2023-02-19 08:00:43,762 INFO [Listener at localhost/46631] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/cluster_97522d0d-516b-9cba-d02d-426c55acf997/zookeeper_0, clientPort=62679, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/cluster_97522d0d-516b-9cba-d02d-426c55acf997/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/cluster_97522d0d-516b-9cba-d02d-426c55acf997/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 08:00:43,763 INFO [Listener at localhost/46631] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62679 2023-02-19 08:00:43,763 INFO [Listener at localhost/46631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,764 INFO [Listener at localhost/46631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,777 INFO [Listener at localhost/46631] util.FSUtils(479): Created version file at hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b with version=8 2023-02-19 08:00:43,777 INFO [Listener at localhost/46631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,778 INFO [Listener at localhost/46631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,779 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35565/user/jenkins/test-data/88df5b40-a271-94a6-3e9d-8996f75ad9a2/hbase-staging 2023-02-19 08:00:43,780 INFO [Listener at localhost/46631] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:43,781 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:43,781 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:43,781 INFO [Listener at localhost/46631] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:43,781 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:43,781 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:43,781 INFO [Listener at localhost/46631] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:43,782 INFO [Listener at localhost/46631] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41783 2023-02-19 08:00:43,782 INFO [Listener at localhost/46631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,783 INFO [Listener at localhost/46631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,783 INFO [Listener at localhost/46631] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41783 connecting to ZooKeeper ensemble=127.0.0.1:62679 2023-02-19 08:00:43,790 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:417830x0, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:43,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41783-0x1006b986cb60000 connected 2023-02-19 08:00:43,807 DEBUG [Listener at localhost/46631] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:43,808 DEBUG [Listener at localhost/46631] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:43,810 DEBUG [Listener at localhost/46631] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:43,811 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41783 2023-02-19 08:00:43,811 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41783 2023-02-19 08:00:43,811 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41783 2023-02-19 08:00:43,812 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41783 2023-02-19 08:00:43,812 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41783 2023-02-19 08:00:43,812 INFO [Listener at localhost/46631] master.HMaster(444): hbase.rootdir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b, hbase.cluster.distributed=false 2023-02-19 08:00:43,829 INFO [Listener at localhost/46631] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:43,829 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:43,829 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:43,829 INFO [Listener at localhost/46631] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:43,829 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:43,829 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:43,830 INFO [Listener at localhost/46631] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:43,830 INFO [Listener at localhost/46631] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46847 2023-02-19 08:00:43,831 INFO [Listener at localhost/46631] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:43,834 DEBUG [Listener at localhost/46631] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:43,834 INFO [Listener at localhost/46631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,835 INFO [Listener at localhost/46631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,836 INFO [Listener at localhost/46631] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46847 connecting to ZooKeeper ensemble=127.0.0.1:62679 2023-02-19 08:00:43,839 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:468470x0, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:43,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46847-0x1006b986cb60001 connected 2023-02-19 08:00:43,841 DEBUG [Listener at localhost/46631] zookeeper.ZKUtil(164): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:43,841 DEBUG [Listener at localhost/46631] zookeeper.ZKUtil(164): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:43,842 DEBUG [Listener at localhost/46631] zookeeper.ZKUtil(164): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:43,844 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46847 2023-02-19 08:00:43,848 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46847 2023-02-19 08:00:43,848 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46847 2023-02-19 08:00:43,848 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46847 2023-02-19 08:00:43,852 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46847 2023-02-19 08:00:43,863 INFO [Listener at localhost/46631] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:43,863 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:43,863 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:43,863 INFO [Listener at localhost/46631] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:43,863 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:43,863 INFO [Listener at localhost/46631] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:43,863 INFO [Listener at localhost/46631] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:43,864 INFO [Listener at localhost/46631] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36267 2023-02-19 08:00:43,864 INFO [Listener at localhost/46631] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:43,865 DEBUG [Listener at localhost/46631] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:43,865 INFO [Listener at localhost/46631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,866 INFO [Listener at localhost/46631] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,867 INFO [Listener at localhost/46631] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36267 connecting to ZooKeeper ensemble=127.0.0.1:62679 2023-02-19 08:00:43,871 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:362670x0, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:43,872 DEBUG [Listener at localhost/46631] zookeeper.ZKUtil(164): regionserver:362670x0, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:43,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36267-0x1006b986cb60002 connected 2023-02-19 08:00:43,873 DEBUG [Listener at localhost/46631] zookeeper.ZKUtil(164): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:43,874 DEBUG [Listener at localhost/46631] zookeeper.ZKUtil(164): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:43,876 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36267 2023-02-19 08:00:43,876 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36267 2023-02-19 08:00:43,876 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36267 2023-02-19 08:00:43,879 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36267 2023-02-19 08:00:43,879 DEBUG [Listener at localhost/46631] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36267 2023-02-19 08:00:43,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41783,1676793643780 2023-02-19 08:00:43,883 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:43,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41783,1676793643780 2023-02-19 08:00:43,885 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:43,885 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:43,885 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:43,885 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:43,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:43,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41783,1676793643780 from backup master directory 2023-02-19 08:00:43,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:43,890 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41783,1676793643780 2023-02-19 08:00:43,890 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:43,890 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:43,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41783,1676793643780 2023-02-19 08:00:43,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/hbase.id with ID: eb320de6-6af2-4f0b-be5b-ba05e82c5b3f 2023-02-19 08:00:43,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:43,914 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:43,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5b4c5422 to 127.0.0.1:62679 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:43,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67ac055c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:43,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:43,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 08:00:43,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:43,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/data/master/store-tmp 2023-02-19 08:00:43,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:43,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:43,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:43,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:43,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:43,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:43,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:43,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:43,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/WALs/jenkins-hbase4.apache.org,41783,1676793643780 2023-02-19 08:00:43,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41783%2C1676793643780, suffix=, logDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/WALs/jenkins-hbase4.apache.org,41783,1676793643780, archiveDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/oldWALs, maxLogs=10 2023-02-19 08:00:43,964 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44005,DS-9a944b36-e3da-4100-8ca6-a3b554cb929e,DISK] 2023-02-19 08:00:43,964 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37031,DS-b389560f-8383-4925-abe3-845150674f5f,DISK] 2023-02-19 08:00:43,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/WALs/jenkins-hbase4.apache.org,41783,1676793643780/jenkins-hbase4.apache.org%2C41783%2C1676793643780.1676793643951 2023-02-19 08:00:43,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44005,DS-9a944b36-e3da-4100-8ca6-a3b554cb929e,DISK], DatanodeInfoWithStorage[127.0.0.1:37031,DS-b389560f-8383-4925-abe3-845150674f5f,DISK]] 2023-02-19 08:00:43,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:43,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:43,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:43,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:43,968 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:43,969 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 08:00:43,969 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 08:00:43,970 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:43,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:43,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:43,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:43,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:43,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63833436, jitterRate=-0.04880768060684204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:43,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:43,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 08:00:43,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 08:00:43,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 08:00:43,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 08:00:43,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 08:00:43,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 08:00:43,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 08:00:43,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 08:00:43,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 08:00:43,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 08:00:43,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 08:00:43,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 08:00:43,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 08:00:43,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 08:00:43,993 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:43,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 08:00:43,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 08:00:43,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 08:00:43,999 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:43,999 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:43,999 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:43,999 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:44,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41783,1676793643780, sessionid=0x1006b986cb60000, setting cluster-up flag (Was=false) 2023-02-19 08:00:44,006 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:44,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 08:00:44,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41783,1676793643780 2023-02-19 08:00:44,014 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:44,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 08:00:44,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41783,1676793643780 2023-02-19 08:00:44,020 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.hbase-snapshot/.tmp 2023-02-19 08:00:44,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:44,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:44,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:44,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:44,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:44,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 08:00:44,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:44,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676793674023 2023-02-19 08:00:44,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 08:00:44,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 08:00:44,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 08:00:44,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 08:00:44,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 08:00:44,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 08:00:44,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,024 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:44,025 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 08:00:44,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 08:00:44,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 08:00:44,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 08:00:44,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 08:00:44,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 08:00:44,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793644026,5,FailOnTimeoutGroup] 2023-02-19 08:00:44,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793644026,5,FailOnTimeoutGroup] 2023-02-19 08:00:44,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 08:00:44,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,026 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:44,033 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:44,033 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:44,033 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b 2023-02-19 08:00:44,038 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:44,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:44,040 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/info 2023-02-19 08:00:44,040 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:44,041 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:44,041 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:44,041 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:44,042 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:44,042 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:44,042 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:44,043 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/table 2023-02-19 08:00:44,043 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:44,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:44,044 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740 2023-02-19 08:00:44,044 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740 2023-02-19 08:00:44,045 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:44,046 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:44,047 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:44,047 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66914241, jitterRate=-0.0029001086950302124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:44,047 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:44,047 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:44,047 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:44,047 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:44,047 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:44,047 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:44,048 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:44,048 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:44,048 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:44,048 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 08:00:44,048 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 08:00:44,050 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 08:00:44,051 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 08:00:44,081 INFO [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(952): ClusterId : eb320de6-6af2-4f0b-be5b-ba05e82c5b3f 2023-02-19 08:00:44,081 INFO [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(952): ClusterId : eb320de6-6af2-4f0b-be5b-ba05e82c5b3f 2023-02-19 08:00:44,081 DEBUG [RS:1;jenkins-hbase4:36267] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:44,081 DEBUG [RS:0;jenkins-hbase4:46847] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:44,083 DEBUG [RS:0;jenkins-hbase4:46847] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:44,083 DEBUG [RS:1;jenkins-hbase4:36267] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:44,083 DEBUG [RS:1;jenkins-hbase4:36267] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:44,083 DEBUG [RS:0;jenkins-hbase4:46847] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:44,085 DEBUG [RS:1;jenkins-hbase4:36267] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:44,085 DEBUG [RS:0;jenkins-hbase4:46847] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:44,086 DEBUG [RS:1;jenkins-hbase4:36267] zookeeper.ReadOnlyZKClient(139): Connect 0x1e5bc39e to 127.0.0.1:62679 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:44,086 DEBUG [RS:0;jenkins-hbase4:46847] zookeeper.ReadOnlyZKClient(139): Connect 0x181f91d1 to 127.0.0.1:62679 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:44,092 DEBUG [RS:1;jenkins-hbase4:36267] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@109c3e25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:44,092 DEBUG [RS:1;jenkins-hbase4:36267] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14a3a8ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:44,092 DEBUG [RS:0;jenkins-hbase4:46847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16d86ca2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:44,093 DEBUG [RS:0;jenkins-hbase4:46847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12e7faa1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:44,101 DEBUG [RS:1;jenkins-hbase4:36267] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36267 2023-02-19 08:00:44,101 DEBUG [RS:0;jenkins-hbase4:46847] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46847 2023-02-19 08:00:44,101 INFO [RS:1;jenkins-hbase4:36267] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:44,101 INFO [RS:1;jenkins-hbase4:36267] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:44,101 INFO [RS:0;jenkins-hbase4:46847] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:44,101 INFO [RS:0;jenkins-hbase4:46847] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:44,101 DEBUG [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:44,101 DEBUG [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:44,102 INFO [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41783,1676793643780 with isa=jenkins-hbase4.apache.org/172.31.14.131:36267, startcode=1676793643862 2023-02-19 08:00:44,102 INFO [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41783,1676793643780 with isa=jenkins-hbase4.apache.org/172.31.14.131:46847, startcode=1676793643828 2023-02-19 08:00:44,102 DEBUG [RS:1;jenkins-hbase4:36267] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:44,102 DEBUG [RS:0;jenkins-hbase4:46847] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:44,103 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35371, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:44,103 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41115, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:44,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41783] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:44,105 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:44,106 DEBUG [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b 2023-02-19 08:00:44,106 DEBUG [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35565 2023-02-19 08:00:44,106 DEBUG [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:44,106 DEBUG [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b 2023-02-19 08:00:44,106 DEBUG [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35565 2023-02-19 08:00:44,106 DEBUG [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:44,107 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:44,110 DEBUG [RS:0;jenkins-hbase4:46847] zookeeper.ZKUtil(162): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:44,110 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46847,1676793643828] 2023-02-19 08:00:44,110 WARN [RS:0;jenkins-hbase4:46847] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:44,110 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36267,1676793643862] 2023-02-19 08:00:44,111 INFO [RS:0;jenkins-hbase4:46847] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:44,111 DEBUG [RS:1;jenkins-hbase4:36267] zookeeper.ZKUtil(162): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:44,111 DEBUG [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/WALs/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:44,111 WARN [RS:1;jenkins-hbase4:36267] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:44,111 INFO [RS:1;jenkins-hbase4:36267] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:44,111 DEBUG [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/WALs/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:44,116 DEBUG [RS:1;jenkins-hbase4:36267] zookeeper.ZKUtil(162): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:44,116 DEBUG [RS:0;jenkins-hbase4:46847] zookeeper.ZKUtil(162): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:44,117 DEBUG [RS:1;jenkins-hbase4:36267] zookeeper.ZKUtil(162): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:44,117 DEBUG [RS:0;jenkins-hbase4:46847] zookeeper.ZKUtil(162): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:44,117 DEBUG [RS:1;jenkins-hbase4:36267] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:44,117 DEBUG [RS:0;jenkins-hbase4:46847] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:44,118 INFO [RS:1;jenkins-hbase4:36267] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:44,118 INFO [RS:0;jenkins-hbase4:46847] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:44,119 INFO [RS:1;jenkins-hbase4:36267] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:44,119 INFO [RS:1;jenkins-hbase4:36267] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:44,119 INFO [RS:1;jenkins-hbase4:36267] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,119 INFO [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:44,120 INFO [RS:0;jenkins-hbase4:46847] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:44,120 INFO [RS:0;jenkins-hbase4:46847] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:44,120 INFO [RS:0;jenkins-hbase4:46847] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,120 INFO [RS:1;jenkins-hbase4:36267] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,121 INFO [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:44,121 DEBUG [RS:1;jenkins-hbase4:36267] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:1;jenkins-hbase4:36267] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:1;jenkins-hbase4:36267] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:1;jenkins-hbase4:36267] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:1;jenkins-hbase4:36267] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:1;jenkins-hbase4:36267] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:44,122 DEBUG [RS:1;jenkins-hbase4:36267] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:1;jenkins-hbase4:36267] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:1;jenkins-hbase4:36267] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 INFO [RS:0;jenkins-hbase4:46847] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,122 DEBUG [RS:1;jenkins-hbase4:36267] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:0;jenkins-hbase4:46847] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:0;jenkins-hbase4:46847] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:0;jenkins-hbase4:46847] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:0;jenkins-hbase4:46847] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:0;jenkins-hbase4:46847] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:0;jenkins-hbase4:46847] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:44,122 DEBUG [RS:0;jenkins-hbase4:46847] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:0;jenkins-hbase4:46847] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,122 DEBUG [RS:0;jenkins-hbase4:46847] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,123 DEBUG [RS:0;jenkins-hbase4:46847] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:44,125 INFO [RS:1;jenkins-hbase4:36267] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,126 INFO [RS:1;jenkins-hbase4:36267] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,126 INFO [RS:1;jenkins-hbase4:36267] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,126 INFO [RS:0;jenkins-hbase4:46847] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,126 INFO [RS:0;jenkins-hbase4:46847] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,127 INFO [RS:0;jenkins-hbase4:46847] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,138 INFO [RS:1;jenkins-hbase4:36267] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:44,138 INFO [RS:1;jenkins-hbase4:36267] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36267,1676793643862-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,138 INFO [RS:0;jenkins-hbase4:46847] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:44,138 INFO [RS:0;jenkins-hbase4:46847] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46847,1676793643828-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,149 INFO [RS:1;jenkins-hbase4:36267] regionserver.Replication(203): jenkins-hbase4.apache.org,36267,1676793643862 started 2023-02-19 08:00:44,149 INFO [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36267,1676793643862, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36267, sessionid=0x1006b986cb60002 2023-02-19 08:00:44,149 INFO [RS:0;jenkins-hbase4:46847] regionserver.Replication(203): jenkins-hbase4.apache.org,46847,1676793643828 started 2023-02-19 08:00:44,149 DEBUG [RS:1;jenkins-hbase4:36267] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:44,149 DEBUG [RS:1;jenkins-hbase4:36267] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:44,149 DEBUG [RS:1;jenkins-hbase4:36267] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36267,1676793643862' 2023-02-19 08:00:44,149 DEBUG [RS:1;jenkins-hbase4:36267] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:44,149 INFO [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46847,1676793643828, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46847, sessionid=0x1006b986cb60001 2023-02-19 08:00:44,150 DEBUG [RS:0;jenkins-hbase4:46847] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:44,150 DEBUG [RS:0;jenkins-hbase4:46847] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:44,150 DEBUG [RS:0;jenkins-hbase4:46847] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46847,1676793643828' 2023-02-19 08:00:44,150 DEBUG [RS:0;jenkins-hbase4:46847] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:44,150 DEBUG [RS:1;jenkins-hbase4:36267] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:44,150 DEBUG [RS:0;jenkins-hbase4:46847] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:44,150 DEBUG [RS:1;jenkins-hbase4:36267] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:44,150 DEBUG [RS:1;jenkins-hbase4:36267] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:44,150 DEBUG [RS:1;jenkins-hbase4:36267] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:44,150 DEBUG [RS:1;jenkins-hbase4:36267] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36267,1676793643862' 2023-02-19 08:00:44,150 DEBUG [RS:0;jenkins-hbase4:46847] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:44,150 DEBUG [RS:0;jenkins-hbase4:46847] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:44,150 DEBUG [RS:1;jenkins-hbase4:36267] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:44,150 DEBUG [RS:0;jenkins-hbase4:46847] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:44,150 DEBUG [RS:0;jenkins-hbase4:46847] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46847,1676793643828' 2023-02-19 08:00:44,150 DEBUG [RS:0;jenkins-hbase4:46847] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:44,150 DEBUG [RS:1;jenkins-hbase4:36267] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:44,151 DEBUG [RS:0;jenkins-hbase4:46847] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:44,151 DEBUG [RS:1;jenkins-hbase4:36267] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:44,151 INFO [RS:1;jenkins-hbase4:36267] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:44,151 INFO [RS:1;jenkins-hbase4:36267] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:44,151 DEBUG [RS:0;jenkins-hbase4:46847] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:44,151 INFO [RS:0;jenkins-hbase4:46847] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:44,151 INFO [RS:0;jenkins-hbase4:46847] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:44,201 DEBUG [jenkins-hbase4:41783] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 08:00:44,201 DEBUG [jenkins-hbase4:41783] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:44,202 DEBUG [jenkins-hbase4:41783] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:44,202 DEBUG [jenkins-hbase4:41783] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:44,202 DEBUG [jenkins-hbase4:41783] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:44,202 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46847,1676793643828, state=OPENING 2023-02-19 08:00:44,205 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 08:00:44,206 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:44,206 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:44,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46847,1676793643828}] 2023-02-19 08:00:44,361 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:44,362 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:44,363 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41866, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:44,368 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 08:00:44,368 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:44,369 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46847%2C1676793643828.meta, suffix=.meta, logDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/WALs/jenkins-hbase4.apache.org,46847,1676793643828, archiveDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/oldWALs, maxLogs=32 2023-02-19 08:00:44,383 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37031,DS-b389560f-8383-4925-abe3-845150674f5f,DISK] 2023-02-19 08:00:44,383 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44005,DS-9a944b36-e3da-4100-8ca6-a3b554cb929e,DISK] 2023-02-19 08:00:44,392 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/WALs/jenkins-hbase4.apache.org,46847,1676793643828/jenkins-hbase4.apache.org%2C46847%2C1676793643828.meta.1676793644369.meta 2023-02-19 08:00:44,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37031,DS-b389560f-8383-4925-abe3-845150674f5f,DISK], DatanodeInfoWithStorage[127.0.0.1:44005,DS-9a944b36-e3da-4100-8ca6-a3b554cb929e,DISK]] 2023-02-19 08:00:44,392 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:44,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 08:00:44,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 08:00:44,393 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 08:00:44,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 08:00:44,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:44,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 08:00:44,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 08:00:44,394 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:44,395 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/info 2023-02-19 08:00:44,395 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/info 2023-02-19 08:00:44,395 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:44,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:44,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:44,396 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:44,396 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:44,396 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:44,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:44,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:44,397 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/table 2023-02-19 08:00:44,397 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/table 2023-02-19 08:00:44,398 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:44,398 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:44,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740 2023-02-19 08:00:44,399 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740 2023-02-19 08:00:44,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:44,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:44,402 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71943667, jitterRate=0.07204417884349823}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:44,402 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:44,403 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676793644361 2023-02-19 08:00:44,406 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 08:00:44,406 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 08:00:44,406 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46847,1676793643828, state=OPEN 2023-02-19 08:00:44,409 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 08:00:44,409 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:44,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 08:00:44,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46847,1676793643828 in 203 msec 2023-02-19 08:00:44,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 08:00:44,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-19 08:00:44,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 391 msec 2023-02-19 08:00:44,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676793644413, completionTime=-1 2023-02-19 08:00:44,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 08:00:44,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 08:00:44,415 DEBUG [hconnection-0x7726e808-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:44,416 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41878, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:44,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 08:00:44,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676793704418 2023-02-19 08:00:44,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676793764418 2023-02-19 08:00:44,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-19 08:00:44,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41783,1676793643780-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41783,1676793643780-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41783,1676793643780-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41783, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:44,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 08:00:44,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:44,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 08:00:44,426 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 08:00:44,427 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:44,427 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:44,428 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/hbase/namespace/281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:44,429 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/hbase/namespace/281a5cd9902858477a64dbe99420d270 empty. 2023-02-19 08:00:44,429 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/hbase/namespace/281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:44,429 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 08:00:44,438 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:44,439 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 281a5cd9902858477a64dbe99420d270, NAME => 'hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp 2023-02-19 08:00:44,446 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:44,446 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 281a5cd9902858477a64dbe99420d270, disabling compactions & flushes 2023-02-19 08:00:44,447 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:44,447 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:44,447 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. after waiting 0 ms 2023-02-19 08:00:44,447 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:44,447 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:44,447 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 281a5cd9902858477a64dbe99420d270: 2023-02-19 08:00:44,448 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:44,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793644449"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793644449"}]},"ts":"1676793644449"} 2023-02-19 08:00:44,451 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:44,452 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:44,452 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793644452"}]},"ts":"1676793644452"} 2023-02-19 08:00:44,453 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 08:00:44,457 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:44,457 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:44,457 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:44,457 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:44,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=281a5cd9902858477a64dbe99420d270, ASSIGN}] 2023-02-19 08:00:44,460 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=281a5cd9902858477a64dbe99420d270, ASSIGN 2023-02-19 08:00:44,460 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=281a5cd9902858477a64dbe99420d270, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36267,1676793643862; forceNewPlan=false, retain=false 2023-02-19 08:00:44,610 INFO [jenkins-hbase4:41783] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:44,611 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=281a5cd9902858477a64dbe99420d270, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:44,611 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793644610"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793644610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793644610"}]},"ts":"1676793644610"} 2023-02-19 08:00:44,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 281a5cd9902858477a64dbe99420d270, server=jenkins-hbase4.apache.org,36267,1676793643862}] 2023-02-19 08:00:44,765 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:44,765 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:44,766 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:44,770 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:44,771 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36267%2C1676793643862, suffix=, logDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/WALs/jenkins-hbase4.apache.org,36267,1676793643862, archiveDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/oldWALs, maxLogs=32 2023-02-19 08:00:44,785 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44005,DS-9a944b36-e3da-4100-8ca6-a3b554cb929e,DISK] 2023-02-19 08:00:44,785 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37031,DS-b389560f-8383-4925-abe3-845150674f5f,DISK] 2023-02-19 08:00:44,786 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/WALs/jenkins-hbase4.apache.org,36267,1676793643862/jenkins-hbase4.apache.org%2C36267%2C1676793643862.1676793644771 2023-02-19 08:00:44,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44005,DS-9a944b36-e3da-4100-8ca6-a3b554cb929e,DISK], DatanodeInfoWithStorage[127.0.0.1:37031,DS-b389560f-8383-4925-abe3-845150674f5f,DISK]] 2023-02-19 08:00:44,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 281a5cd9902858477a64dbe99420d270, NAME => 'hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:44,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:44,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:44,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:44,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:44,788 INFO [StoreOpener-281a5cd9902858477a64dbe99420d270-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:44,789 DEBUG [StoreOpener-281a5cd9902858477a64dbe99420d270-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/namespace/281a5cd9902858477a64dbe99420d270/info 2023-02-19 08:00:44,789 DEBUG [StoreOpener-281a5cd9902858477a64dbe99420d270-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/namespace/281a5cd9902858477a64dbe99420d270/info 2023-02-19 08:00:44,789 INFO [StoreOpener-281a5cd9902858477a64dbe99420d270-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 281a5cd9902858477a64dbe99420d270 columnFamilyName info 2023-02-19 08:00:44,790 INFO [StoreOpener-281a5cd9902858477a64dbe99420d270-1] regionserver.HStore(310): Store=281a5cd9902858477a64dbe99420d270/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:44,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/namespace/281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:44,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/namespace/281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:44,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:44,794 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/namespace/281a5cd9902858477a64dbe99420d270/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:44,795 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 281a5cd9902858477a64dbe99420d270; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73344267, jitterRate=0.09291474521160126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:44,795 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 281a5cd9902858477a64dbe99420d270: 2023-02-19 08:00:44,796 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270., pid=6, masterSystemTime=1676793644765 2023-02-19 08:00:44,799 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:44,800 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:44,800 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=281a5cd9902858477a64dbe99420d270, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:44,800 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793644800"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793644800"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793644800"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793644800"}]},"ts":"1676793644800"} 2023-02-19 08:00:44,802 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 08:00:44,802 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 281a5cd9902858477a64dbe99420d270, server=jenkins-hbase4.apache.org,36267,1676793643862 in 189 msec 2023-02-19 08:00:44,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 08:00:44,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=281a5cd9902858477a64dbe99420d270, ASSIGN in 345 msec 2023-02-19 08:00:44,804 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:44,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793644804"}]},"ts":"1676793644804"} 2023-02-19 08:00:44,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 08:00:44,808 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:44,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-19 08:00:44,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 08:00:44,827 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 08:00:44,827 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:44,828 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-19 08:00:44,828 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:44,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:44,831 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32864, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:44,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 08:00:44,841 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:44,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-19 08:00:44,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 08:00:44,860 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:44,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-19 08:00:44,868 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 08:00:44,870 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 08:00:44,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.980sec 2023-02-19 08:00:44,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 08:00:44,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 08:00:44,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 08:00:44,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41783,1676793643780-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 08:00:44,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41783,1676793643780-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 08:00:44,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 08:00:44,881 DEBUG [Listener at localhost/46631] zookeeper.ReadOnlyZKClient(139): Connect 0x024aca78 to 127.0.0.1:62679 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:44,889 DEBUG [Listener at localhost/46631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17914395, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:44,891 DEBUG [hconnection-0x6b62d67b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:44,892 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41892, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:44,893 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41783,1676793643780 2023-02-19 08:00:44,894 DEBUG [Listener at localhost/46631] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 08:00:44,897 DEBUG [Listener at localhost/46631] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 08:00:44,899 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44354, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 08:00:44,899 INFO [Listener at localhost/46631] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-19 08:00:44,900 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-19 08:00:44,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 08:00:44,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:44354 deadline: 1676793704900, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-19 08:00:44,900 INFO [Listener at localhost/46631] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-19 08:00:44,902 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:44,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:44,904 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:44,904 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-19 08:00:44,905 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:44,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:44,906 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:44,906 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45 empty. 2023-02-19 08:00:44,906 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:44,907 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-19 08:00:44,914 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:44,915 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 94a6ef54cda6bd351b4a6da194344c45, NAME => 'testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp 2023-02-19 08:00:44,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:44,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 94a6ef54cda6bd351b4a6da194344c45, disabling compactions & flushes 2023-02-19 08:00:44,920 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:44,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:44,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. after waiting 0 ms 2023-02-19 08:00:44,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:44,920 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:44,920 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 94a6ef54cda6bd351b4a6da194344c45: 2023-02-19 08:00:44,922 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:44,922 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676793644922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793644922"}]},"ts":"1676793644922"} 2023-02-19 08:00:44,924 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:44,924 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:44,924 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793644924"}]},"ts":"1676793644924"} 2023-02-19 08:00:44,926 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-19 08:00:44,929 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:44,930 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:44,930 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:44,930 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:44,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=94a6ef54cda6bd351b4a6da194344c45, ASSIGN}] 2023-02-19 08:00:44,932 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=94a6ef54cda6bd351b4a6da194344c45, ASSIGN 2023-02-19 08:00:44,933 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=94a6ef54cda6bd351b4a6da194344c45, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36267,1676793643862; forceNewPlan=false, retain=false 2023-02-19 08:00:45,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:45,083 INFO [jenkins-hbase4:41783] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:45,083 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=94a6ef54cda6bd351b4a6da194344c45, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,083 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676793645083"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793645083"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793645083"}]},"ts":"1676793645083"} 2023-02-19 08:00:45,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 94a6ef54cda6bd351b4a6da194344c45, server=jenkins-hbase4.apache.org,36267,1676793643862}] 2023-02-19 08:00:45,153 INFO [RS:0;jenkins-hbase4:46847] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46847%2C1676793643828, suffix=, logDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/WALs/jenkins-hbase4.apache.org,46847,1676793643828, archiveDir=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/oldWALs, maxLogs=32 2023-02-19 08:00:45,165 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37031,DS-b389560f-8383-4925-abe3-845150674f5f,DISK] 2023-02-19 08:00:45,165 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44005,DS-9a944b36-e3da-4100-8ca6-a3b554cb929e,DISK] 2023-02-19 08:00:45,166 INFO [RS:0;jenkins-hbase4:46847] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/WALs/jenkins-hbase4.apache.org,46847,1676793643828/jenkins-hbase4.apache.org%2C46847%2C1676793643828.1676793645153 2023-02-19 08:00:45,167 DEBUG [RS:0;jenkins-hbase4:46847] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37031,DS-b389560f-8383-4925-abe3-845150674f5f,DISK], DatanodeInfoWithStorage[127.0.0.1:44005,DS-9a944b36-e3da-4100-8ca6-a3b554cb929e,DISK]] 2023-02-19 08:00:45,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:45,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:45,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 94a6ef54cda6bd351b4a6da194344c45, NAME => 'testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:45,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:45,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:45,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:45,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:45,241 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:45,242 DEBUG [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1 2023-02-19 08:00:45,242 DEBUG [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1 2023-02-19 08:00:45,243 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94a6ef54cda6bd351b4a6da194344c45 columnFamilyName f1 2023-02-19 08:00:45,243 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] regionserver.HStore(310): Store=94a6ef54cda6bd351b4a6da194344c45/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:45,243 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:45,244 DEBUG [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2 2023-02-19 08:00:45,244 DEBUG [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2 2023-02-19 08:00:45,245 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94a6ef54cda6bd351b4a6da194344c45 columnFamilyName f2 2023-02-19 08:00:45,245 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] regionserver.HStore(310): Store=94a6ef54cda6bd351b4a6da194344c45/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:45,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:45,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:45,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:45,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:45,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 94a6ef54cda6bd351b4a6da194344c45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61032055, jitterRate=-0.09055151045322418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:45,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 94a6ef54cda6bd351b4a6da194344c45: 2023-02-19 08:00:45,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45., pid=12, masterSystemTime=1676793645237 2023-02-19 08:00:45,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:45,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:45,252 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=94a6ef54cda6bd351b4a6da194344c45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,252 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676793645252"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793645252"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793645252"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793645252"}]},"ts":"1676793645252"} 2023-02-19 08:00:45,255 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 08:00:45,255 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 94a6ef54cda6bd351b4a6da194344c45, server=jenkins-hbase4.apache.org,36267,1676793643862 in 168 msec 2023-02-19 08:00:45,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 08:00:45,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=94a6ef54cda6bd351b4a6da194344c45, ASSIGN in 325 msec 2023-02-19 08:00:45,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:45,257 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793645256"}]},"ts":"1676793645256"} 2023-02-19 08:00:45,258 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-19 08:00:45,259 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:45,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 357 msec 2023-02-19 08:00:45,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:45,509 INFO [Listener at localhost/46631] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-19 08:00:45,509 DEBUG [Listener at localhost/46631] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-19 08:00:45,510 INFO [Listener at localhost/46631] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:45,513 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-19 08:00:45,513 INFO [Listener at localhost/46631] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:45,513 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-19 08:00:45,513 INFO [Listener at localhost/46631] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 08:00:45,526 DEBUG [hconnection-0x6b62d67b-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:45,543 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32876, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:45,550 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36267] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:45,637 INFO [Listener at localhost/46631] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 08:00:45,638 INFO [Listener at localhost/46631] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 08:00:45,639 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-19 08:00:45,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676793645639 (current time:1676793645639). 2023-02-19 08:00:45,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 08:00:45,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] zookeeper.ReadOnlyZKClient(139): Connect 0x01f2c797 to 127.0.0.1:62679 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:45,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@205be7d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:45,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:45,644 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41898, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:45,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01f2c797 to 127.0.0.1:62679 2023-02-19 08:00:45,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:45,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 08:00:45,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-19 08:00:45,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-19 08:00:45,648 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-19 08:00:45,648 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676794245648 2023-02-19 08:00:45,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-19 08:00:45,649 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,650 DEBUG [Listener at localhost/46631] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:45,650 DEBUG [Listener at localhost/46631] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 08:00:45,650 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-19 08:00:45,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-19 08:00:45,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-19 08:00:45,652 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-19 08:00:45,652 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676794245652 2023-02-19 08:00:45,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,659 INFO [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-19 08:00:45,659 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:45,660 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-19 08:00:45,660 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-19 08:00:45,660 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,660 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,661 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:45,661 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:45,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:45,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:45,661 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,662 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,662 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:45,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-19 08:00:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-19 08:00:45,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-19 08:00:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,663 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-19 08:00:45,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,663 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-19 08:00:45,663 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:45,663 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-19 08:00:45,663 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 08:00:45,663 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:45,664 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 08:00:45,664 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46847,1676793643828' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 08:00:45,664 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 08:00:45,664 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 08:00:45,664 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36267,1676793643862' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 08:00:45,667 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,668 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,668 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:45,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:45,668 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,668 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:45,668 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,668 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:45,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:45,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:45,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:45,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:45,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36267,1676793643862' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-19 08:00:45,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67fdefb7[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:45,669 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-19 08:00:45,669 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,671 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,671 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,671 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 08:00:45,671 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 08:00:45,671 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 08:00:45,671 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,671 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:45,671 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46847,1676793643828' in zk 2023-02-19 08:00:45,671 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 08:00:45,671 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 08:00:45,671 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:45,671 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. started... 2023-02-19 08:00:45,671 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 94a6ef54cda6bd351b4a6da194344c45 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 08:00:45,672 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 08:00:45,672 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:45,672 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 08:00:45,685 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/.tmp/f1/0aad86f9b60e4ac5ac9f9c775de23471 2023-02-19 08:00:45,706 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/.tmp/f2/de97bcdeef804d8b8a8bcb8d6d495ea1 2023-02-19 08:00:45,710 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/.tmp/f1/0aad86f9b60e4ac5ac9f9c775de23471 as hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/0aad86f9b60e4ac5ac9f9c775de23471 2023-02-19 08:00:45,713 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/0aad86f9b60e4ac5ac9f9c775de23471, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 08:00:45,714 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/.tmp/f2/de97bcdeef804d8b8a8bcb8d6d495ea1 as hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/de97bcdeef804d8b8a8bcb8d6d495ea1 2023-02-19 08:00:45,717 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/de97bcdeef804d8b8a8bcb8d6d495ea1, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 08:00:45,718 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 94a6ef54cda6bd351b4a6da194344c45 in 47ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:45,718 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-19 08:00:45,718 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 94a6ef54cda6bd351b4a6da194344c45: 2023-02-19 08:00:45,718 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,718 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:45,718 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/0aad86f9b60e4ac5ac9f9c775de23471] hfiles 2023-02-19 08:00:45,719 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/0aad86f9b60e4ac5ac9f9c775de23471 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,719 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/de97bcdeef804d8b8a8bcb8d6d495ea1] hfiles 2023-02-19 08:00:45,719 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/de97bcdeef804d8b8a8bcb8d6d495ea1 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,723 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. completed. 2023-02-19 08:00:45,723 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 08:00:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 08:00:45,723 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,724 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 08:00:45,724 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36267,1676793643862' in zk 2023-02-19 08:00:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 08:00:45,728 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 08:00:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,36267,1676793643862': 2023-02-19 08:00:45,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36267,1676793643862' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-19 08:00:45,731 INFO [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-19 08:00:45,732 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:45,732 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:45,732 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,732 INFO [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 08:00:45,733 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,733 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:45,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,733 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:45,733 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,733 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:45,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:45,734 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:45,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,734 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,735 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:45,736 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,740 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:45,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,741 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:45,741 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:45,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:45,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,741 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:45,750 DEBUG [Listener at localhost/46631] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:45,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-19 08:00:45,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:45,752 DEBUG [Listener at localhost/46631] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 08:00:45,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,771 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-19 08:00:45,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,772 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:45,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676793645649Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676793645741 (+92 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676793645741Writing data manifest for testWithMockedMapReduceSingleRegion at 1676793645743 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676793645750 (+7 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676793645771 (+21 ms) 2023-02-19 08:00:45,774 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-19 08:00:45,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 125 msec 2023-02-19 08:00:45,952 DEBUG [Listener at localhost/46631] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:45,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-19 08:00:45,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 08:00:45,954 INFO [Listener at localhost/46631] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 08:00:45,958 INFO [Listener at localhost/46631] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 08:00:45,963 INFO [Listener at localhost/46631] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 08:00:45,996 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36267] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,087 INFO [Listener at localhost/46631] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 08:00:46,092 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 08:00:46,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,093 INFO [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-19 08:00:46,093 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:46,094 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-19 08:00:46,094 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-19 08:00:46,095 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,095 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,097 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:46,097 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:46,097 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:46,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:46,097 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,097 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,099 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-19 08:00:46,099 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:46,099 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-19 08:00:46,099 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 08:00:46,099 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 08:00:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 08:00:46,100 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 08:00:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 08:00:46,100 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. started... 2023-02-19 08:00:46,100 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46847,1676793643828' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 08:00:46,101 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 94a6ef54cda6bd351b4a6da194344c45 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 08:00:46,102 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,102 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,102 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:46,116 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/.tmp/f1/0674cfb969a145e8a4ba7e780a4a6fd7 2023-02-19 08:00:46,132 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/.tmp/f2/8604d5f621c942b9b71f7106a836c6fd 2023-02-19 08:00:46,136 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/.tmp/f1/0674cfb969a145e8a4ba7e780a4a6fd7 as hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/0674cfb969a145e8a4ba7e780a4a6fd7 2023-02-19 08:00:46,139 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/0674cfb969a145e8a4ba7e780a4a6fd7, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 08:00:46,140 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/.tmp/f2/8604d5f621c942b9b71f7106a836c6fd as hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/8604d5f621c942b9b71f7106a836c6fd 2023-02-19 08:00:46,144 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/8604d5f621c942b9b71f7106a836c6fd, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 08:00:46,145 INFO [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 94a6ef54cda6bd351b4a6da194344c45 in 44ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:46,146 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 94a6ef54cda6bd351b4a6da194344c45: 2023-02-19 08:00:46,146 DEBUG [rs(jenkins-hbase4.apache.org,36267,1676793643862)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,146 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 08:00:46,146 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 08:00:46,146 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,146 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-19 08:00:46,146 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36267,1676793643862' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-19 08:00:46,147 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,147 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:46,148 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,148 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:46,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:46,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36267,1676793643862' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-19 08:00:46,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63c26790[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:46,149 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-19 08:00:46,149 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,150 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,150 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,151 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 08:00:46,151 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 08:00:46,151 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 08:00:46,151 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-19 08:00:46,151 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46847,1676793643828' in zk 2023-02-19 08:00:46,151 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,151 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:46,151 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36267,1676793643862' in zk 2023-02-19 08:00:46,154 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 08:00:46,154 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,154 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-19 08:00:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:46,154 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:46,154 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:46,154 DEBUG [member: 'jenkins-hbase4.apache.org,36267,1676793643862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 08:00:46,154 DEBUG [member: 'jenkins-hbase4.apache.org,46847,1676793643828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-19 08:00:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:46,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,36267,1676793643862': 2023-02-19 08:00:46,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36267,1676793643862' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-19 08:00:46,156 INFO [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-19 08:00:46,156 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:46,157 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:46,157 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,157 INFO [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 08:00:46,158 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,158 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,158 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,158 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:46,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:46,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:46,158 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:46,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:46,158 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:46,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,159 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:46,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:46,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,160 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:46,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:46,161 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:46,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,163 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:46,163 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:46,163 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:46,163 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:46,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:46,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:46,163 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:46,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:46,163 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-19 08:00:46,163 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 08:00:46,163 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,163 DEBUG [(jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:46,164 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:46,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:46,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:46,164 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,164 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,164 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,164 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:46,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:46,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:46,164 DEBUG [Listener at localhost/46631] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:46,164 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,164 DEBUG [Listener at localhost/46631] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 08:00:46,164 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,264 DEBUG [Listener at localhost/46631] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 08:00:46,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 08:00:46,269 INFO [Listener at localhost/46631] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676793645639 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:46,269 DEBUG [Listener at localhost/46631] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35565/user/jenkins/test-data/88df5b40-a271-94a6-3e9d-8996f75ad9a2/testWithMockedMapReduceSingleRegion/fd9f9cf9-020f-4f8c-8fa0-cc3a7502cca0/data/default/testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,270 INFO [Listener at localhost/46631] snapshot.RestoreSnapshotHelper(239): region to add: 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:46,270 INFO [Listener at localhost/46631] snapshot.RestoreSnapshotHelper(585): clone region=94a6ef54cda6bd351b4a6da194344c45 as 94a6ef54cda6bd351b4a6da194344c45 in snapshot testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,271 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 94a6ef54cda6bd351b4a6da194344c45, NAME => 'testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35565/user/jenkins/test-data/88df5b40-a271-94a6-3e9d-8996f75ad9a2/testWithMockedMapReduceSingleRegion/fd9f9cf9-020f-4f8c-8fa0-cc3a7502cca0 2023-02-19 08:00:46,276 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:46,276 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0aad86f9b60e4ac5ac9f9c775de23471 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,279 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink de97bcdeef804d8b8a8bcb8d6d495ea1 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 94a6ef54cda6bd351b4a6da194344c45, disabling compactions & flushes 2023-02-19 08:00:46,281 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. after waiting 0 ms 2023-02-19 08:00:46,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,281 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 94a6ef54cda6bd351b4a6da194344c45: 2023-02-19 08:00:46,281 INFO [Listener at localhost/46631] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676793645639 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:46,281 DEBUG [Listener at localhost/46631] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35565/user/jenkins/test-data/88df5b40-a271-94a6-3e9d-8996f75ad9a2/testWithMockedMapReduceSingleRegion/fd9f9cf9-020f-4f8c-8fa0-cc3a7502cca0 2023-02-19 08:00:46,281 DEBUG [Listener at localhost/46631] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35565/user/jenkins/test-data/88df5b40-a271-94a6-3e9d-8996f75ad9a2/testWithMockedMapReduceSingleRegion/fd9f9cf9-020f-4f8c-8fa0-cc3a7502cca0 2023-02-19 08:00:46,282 DEBUG [Listener at localhost/46631] util.CommonFSUtils(699): |-data/ 2023-02-19 08:00:46,282 DEBUG [Listener at localhost/46631] util.CommonFSUtils(699): |----default/ 2023-02-19 08:00:46,282 DEBUG [Listener at localhost/46631] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-19 08:00:46,282 DEBUG [Listener at localhost/46631] util.CommonFSUtils(699): |----------94a6ef54cda6bd351b4a6da194344c45/ 2023-02-19 08:00:46,283 DEBUG [Listener at localhost/46631] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:46,283 DEBUG [Listener at localhost/46631] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:46,283 DEBUG [Listener at localhost/46631] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=94a6ef54cda6bd351b4a6da194344c45-0aad86f9b60e4ac5ac9f9c775de23471 2023-02-19 08:00:46,283 DEBUG [Listener at localhost/46631] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:46,283 DEBUG [Listener at localhost/46631] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=94a6ef54cda6bd351b4a6da194344c45-de97bcdeef804d8b8a8bcb8d6d495ea1 2023-02-19 08:00:46,286 INFO [Listener at localhost/46631] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 08:00:46,289 DEBUG [Listener at localhost/46631] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:46,289 INFO [Listener at localhost/46631] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:46,289 DEBUG [Listener at localhost/46631] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:46,291 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:46,291 DEBUG [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/88df5b40-a271-94a6-3e9d-8996f75ad9a2/testWithMockedMapReduceSingleRegion/fd9f9cf9-020f-4f8c-8fa0-cc3a7502cca0/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1 2023-02-19 08:00:46,292 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94a6ef54cda6bd351b4a6da194344c45 columnFamilyName f1 2023-02-19 08:00:46,295 DEBUG [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] regionserver.HStore(539): loaded hdfs://localhost:35565/user/jenkins/test-data/88df5b40-a271-94a6-3e9d-8996f75ad9a2/testWithMockedMapReduceSingleRegion/fd9f9cf9-020f-4f8c-8fa0-cc3a7502cca0/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/testWithMockedMapReduceSingleRegion=94a6ef54cda6bd351b4a6da194344c45-0aad86f9b60e4ac5ac9f9c775de23471 2023-02-19 08:00:46,295 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] regionserver.HStore(310): Store=94a6ef54cda6bd351b4a6da194344c45/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:46,295 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:46,295 DEBUG [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35565/user/jenkins/test-data/88df5b40-a271-94a6-3e9d-8996f75ad9a2/testWithMockedMapReduceSingleRegion/fd9f9cf9-020f-4f8c-8fa0-cc3a7502cca0/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2 2023-02-19 08:00:46,296 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94a6ef54cda6bd351b4a6da194344c45 columnFamilyName f2 2023-02-19 08:00:46,299 DEBUG [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] regionserver.HStore(539): loaded hdfs://localhost:35565/user/jenkins/test-data/88df5b40-a271-94a6-3e9d-8996f75ad9a2/testWithMockedMapReduceSingleRegion/fd9f9cf9-020f-4f8c-8fa0-cc3a7502cca0/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/testWithMockedMapReduceSingleRegion=94a6ef54cda6bd351b4a6da194344c45-de97bcdeef804d8b8a8bcb8d6d495ea1 2023-02-19 08:00:46,299 INFO [StoreOpener-94a6ef54cda6bd351b4a6da194344c45-1] regionserver.HStore(310): Store=94a6ef54cda6bd351b4a6da194344c45/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:46,299 DEBUG [Listener at localhost/46631] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:46,299 INFO [Listener at localhost/46631] regionserver.HRegion(1071): Opened 94a6ef54cda6bd351b4a6da194344c45; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62568110, jitterRate=-0.06766250729560852}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:46,299 DEBUG [Listener at localhost/46631] regionserver.HRegion(964): Region open journal for 94a6ef54cda6bd351b4a6da194344c45: 2023-02-19 08:00:46,345 DEBUG [Listener at localhost/46631] regionserver.HRegion(1603): Closing 94a6ef54cda6bd351b4a6da194344c45, disabling compactions & flushes 2023-02-19 08:00:46,345 INFO [Listener at localhost/46631] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,345 DEBUG [Listener at localhost/46631] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,345 DEBUG [Listener at localhost/46631] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. after waiting 0 ms 2023-02-19 08:00:46,345 DEBUG [Listener at localhost/46631] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,346 INFO [Listener at localhost/46631] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,346 DEBUG [Listener at localhost/46631] regionserver.HRegion(1557): Region close journal for 94a6ef54cda6bd351b4a6da194344c45: 2023-02-19 08:00:46,350 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-19 08:00:46,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,352 INFO [Listener at localhost/46631] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,353 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:46,356 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793646356"}]},"ts":"1676793646356"} 2023-02-19 08:00:46,357 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-19 08:00:46,359 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-19 08:00:46,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=94a6ef54cda6bd351b4a6da194344c45, UNASSIGN}] 2023-02-19 08:00:46,361 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=94a6ef54cda6bd351b4a6da194344c45, UNASSIGN 2023-02-19 08:00:46,361 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=94a6ef54cda6bd351b4a6da194344c45, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,361 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676793646361"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793646361"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793646361"}]},"ts":"1676793646361"} 2023-02-19 08:00:46,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 94a6ef54cda6bd351b4a6da194344c45, server=jenkins-hbase4.apache.org,36267,1676793643862}] 2023-02-19 08:00:46,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:46,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:46,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 94a6ef54cda6bd351b4a6da194344c45, disabling compactions & flushes 2023-02-19 08:00:46,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. after waiting 0 ms 2023-02-19 08:00:46,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:46,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45. 2023-02-19 08:00:46,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 94a6ef54cda6bd351b4a6da194344c45: 2023-02-19 08:00:46,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:46,522 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=94a6ef54cda6bd351b4a6da194344c45, regionState=CLOSED 2023-02-19 08:00:46,522 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676793646522"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793646522"}]},"ts":"1676793646522"} 2023-02-19 08:00:46,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 08:00:46,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 94a6ef54cda6bd351b4a6da194344c45, server=jenkins-hbase4.apache.org,36267,1676793643862 in 161 msec 2023-02-19 08:00:46,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 08:00:46,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=94a6ef54cda6bd351b4a6da194344c45, UNASSIGN in 166 msec 2023-02-19 08:00:46,526 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793646526"}]},"ts":"1676793646526"} 2023-02-19 08:00:46,527 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-19 08:00:46,528 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-19 08:00:46,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-19 08:00:46,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:46,662 INFO [Listener at localhost/46631] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-19 08:00:46,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,664 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,665 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 08:00:46,667 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:46,669 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1, FileablePath, hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2, FileablePath, hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/recovered.edits] 2023-02-19 08:00:46,671 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/0674cfb969a145e8a4ba7e780a4a6fd7 to hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/archive/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/0674cfb969a145e8a4ba7e780a4a6fd7 2023-02-19 08:00:46,673 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/0aad86f9b60e4ac5ac9f9c775de23471 to hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/archive/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f1/0aad86f9b60e4ac5ac9f9c775de23471 2023-02-19 08:00:46,675 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/8604d5f621c942b9b71f7106a836c6fd to hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/archive/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/8604d5f621c942b9b71f7106a836c6fd 2023-02-19 08:00:46,676 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/de97bcdeef804d8b8a8bcb8d6d495ea1 to hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/archive/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/f2/de97bcdeef804d8b8a8bcb8d6d495ea1 2023-02-19 08:00:46,678 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/recovered.edits/12.seqid to hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/archive/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45/recovered.edits/12.seqid 2023-02-19 08:00:46,679 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/.tmp/data/default/testWithMockedMapReduceSingleRegion/94a6ef54cda6bd351b4a6da194344c45 2023-02-19 08:00:46,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-19 08:00:46,680 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,682 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-19 08:00:46,683 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-19 08:00:46,684 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,684 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-19 08:00:46,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793646684"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:46,685 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 08:00:46,685 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 94a6ef54cda6bd351b4a6da194344c45, NAME => 'testWithMockedMapReduceSingleRegion,,1676793644902.94a6ef54cda6bd351b4a6da194344c45.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 08:00:46,685 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-19 08:00:46,686 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676793646686"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:46,687 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-19 08:00:46,688 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-19 08:00:46,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-19 08:00:46,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41783] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 08:00:46,767 INFO [Listener at localhost/46631] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-19 08:00:46,767 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 08:00:46,767 INFO [Listener at localhost/46631] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 08:00:46,768 DEBUG [Listener at localhost/46631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x024aca78 to 127.0.0.1:62679 2023-02-19 08:00:46,768 DEBUG [Listener at localhost/46631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:46,768 DEBUG [Listener at localhost/46631] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 08:00:46,768 DEBUG [Listener at localhost/46631] util.JVMClusterUtil(257): Found active master hash=630378816, stopped=false 2023-02-19 08:00:46,768 INFO [Listener at localhost/46631] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41783,1676793643780 2023-02-19 08:00:46,772 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:46,773 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:46,773 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:46,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:46,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:46,774 INFO [Listener at localhost/46631] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 08:00:46,777 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:46,777 DEBUG [Listener at localhost/46631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b4c5422 to 127.0.0.1:62679 2023-02-19 08:00:46,777 DEBUG [Listener at localhost/46631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:46,777 INFO [Listener at localhost/46631] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46847,1676793643828' ***** 2023-02-19 08:00:46,777 INFO [Listener at localhost/46631] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:46,778 INFO [Listener at localhost/46631] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36267,1676793643862' ***** 2023-02-19 08:00:46,778 INFO [Listener at localhost/46631] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:46,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:46,778 INFO [RS:0;jenkins-hbase4:46847] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:46,778 INFO [RS:1;jenkins-hbase4:36267] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:46,778 INFO [RS:0;jenkins-hbase4:46847] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:46,778 INFO [RS:1;jenkins-hbase4:36267] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:46,778 INFO [RS:0;jenkins-hbase4:46847] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:46,778 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:46,778 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:46,779 INFO [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:46,778 INFO [RS:1;jenkins-hbase4:36267] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:46,779 DEBUG [RS:0;jenkins-hbase4:46847] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x181f91d1 to 127.0.0.1:62679 2023-02-19 08:00:46,779 INFO [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(3304): Received CLOSE for 281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:46,779 INFO [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,779 DEBUG [RS:1;jenkins-hbase4:36267] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e5bc39e to 127.0.0.1:62679 2023-02-19 08:00:46,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 281a5cd9902858477a64dbe99420d270, disabling compactions & flushes 2023-02-19 08:00:46,779 DEBUG [RS:0;jenkins-hbase4:46847] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:46,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:46,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:46,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. after waiting 0 ms 2023-02-19 08:00:46,779 DEBUG [RS:1;jenkins-hbase4:36267] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:46,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:46,779 INFO [RS:0;jenkins-hbase4:46847] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:46,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 281a5cd9902858477a64dbe99420d270 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 08:00:46,779 INFO [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 08:00:46,780 INFO [RS:0;jenkins-hbase4:46847] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:46,780 INFO [RS:0;jenkins-hbase4:46847] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:46,780 DEBUG [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1479): Online Regions={281a5cd9902858477a64dbe99420d270=hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270.} 2023-02-19 08:00:46,780 DEBUG [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1505): Waiting on 281a5cd9902858477a64dbe99420d270 2023-02-19 08:00:46,780 INFO [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 08:00:46,787 INFO [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 08:00:46,787 DEBUG [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-19 08:00:46,787 DEBUG [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 08:00:46,787 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:46,787 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:46,787 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:46,787 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:46,787 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:46,787 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-19 08:00:46,801 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/.tmp/info/f8ab7527b0aa418d85c671b52fbb436a 2023-02-19 08:00:46,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/namespace/281a5cd9902858477a64dbe99420d270/.tmp/info/2045a0666da3478db9d5df0123272687 2023-02-19 08:00:46,806 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8ab7527b0aa418d85c671b52fbb436a 2023-02-19 08:00:46,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/namespace/281a5cd9902858477a64dbe99420d270/.tmp/info/2045a0666da3478db9d5df0123272687 as hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/namespace/281a5cd9902858477a64dbe99420d270/info/2045a0666da3478db9d5df0123272687 2023-02-19 08:00:46,819 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/.tmp/rep_barrier/7628b952273e4bc3b478b6e0571bd8cb 2023-02-19 08:00:46,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/namespace/281a5cd9902858477a64dbe99420d270/info/2045a0666da3478db9d5df0123272687, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 08:00:46,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 281a5cd9902858477a64dbe99420d270 in 44ms, sequenceid=6, compaction requested=false 2023-02-19 08:00:46,825 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7628b952273e4bc3b478b6e0571bd8cb 2023-02-19 08:00:46,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/namespace/281a5cd9902858477a64dbe99420d270/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 08:00:46,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:46,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 281a5cd9902858477a64dbe99420d270: 2023-02-19 08:00:46,829 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:46,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676793644425.281a5cd9902858477a64dbe99420d270. 2023-02-19 08:00:46,829 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:46,855 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/.tmp/table/c2d785f50c34487f8aa145e98a628d4c 2023-02-19 08:00:46,859 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2d785f50c34487f8aa145e98a628d4c 2023-02-19 08:00:46,860 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/.tmp/info/f8ab7527b0aa418d85c671b52fbb436a as hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/info/f8ab7527b0aa418d85c671b52fbb436a 2023-02-19 08:00:46,865 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8ab7527b0aa418d85c671b52fbb436a 2023-02-19 08:00:46,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/info/f8ab7527b0aa418d85c671b52fbb436a, entries=12, sequenceid=21, filesize=6.3 K 2023-02-19 08:00:46,866 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/.tmp/rep_barrier/7628b952273e4bc3b478b6e0571bd8cb as hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/rep_barrier/7628b952273e4bc3b478b6e0571bd8cb 2023-02-19 08:00:46,870 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7628b952273e4bc3b478b6e0571bd8cb 2023-02-19 08:00:46,870 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/rep_barrier/7628b952273e4bc3b478b6e0571bd8cb, entries=1, sequenceid=21, filesize=5.0 K 2023-02-19 08:00:46,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/.tmp/table/c2d785f50c34487f8aa145e98a628d4c as hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/table/c2d785f50c34487f8aa145e98a628d4c 2023-02-19 08:00:46,877 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2d785f50c34487f8aa145e98a628d4c 2023-02-19 08:00:46,877 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/table/c2d785f50c34487f8aa145e98a628d4c, entries=4, sequenceid=21, filesize=5.1 K 2023-02-19 08:00:46,880 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 93ms, sequenceid=21, compaction requested=false 2023-02-19 08:00:46,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 08:00:46,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 08:00:46,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:46,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:46,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:46,981 INFO [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36267,1676793643862; all regions closed. 2023-02-19 08:00:46,984 DEBUG [RS:1;jenkins-hbase4:36267] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/oldWALs 2023-02-19 08:00:46,985 INFO [RS:1;jenkins-hbase4:36267] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36267%2C1676793643862:(num 1676793644771) 2023-02-19 08:00:46,985 DEBUG [RS:1;jenkins-hbase4:36267] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:46,985 INFO [RS:1;jenkins-hbase4:36267] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:46,985 INFO [RS:1;jenkins-hbase4:36267] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:46,985 INFO [RS:1;jenkins-hbase4:36267] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:46,985 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:46,985 INFO [RS:1;jenkins-hbase4:36267] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:46,985 INFO [RS:1;jenkins-hbase4:36267] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:46,986 INFO [RS:1;jenkins-hbase4:36267] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36267 2023-02-19 08:00:46,987 INFO [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46847,1676793643828; all regions closed. 2023-02-19 08:00:46,988 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,988 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:46,988 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36267,1676793643862 2023-02-19 08:00:46,988 ERROR [Listener at localhost/46631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c0f87ff rejected from java.util.concurrent.ThreadPoolExecutor@83012a6[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:46,988 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:46,988 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:46,988 ERROR [Listener at localhost/46631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c755b7d rejected from java.util.concurrent.ThreadPoolExecutor@83012a6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:46,989 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36267,1676793643862] 2023-02-19 08:00:46,989 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36267,1676793643862; numProcessing=1 2023-02-19 08:00:46,990 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36267,1676793643862 already deleted, retry=false 2023-02-19 08:00:46,990 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36267,1676793643862 expired; onlineServers=1 2023-02-19 08:00:46,991 DEBUG [RS:0;jenkins-hbase4:46847] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/oldWALs 2023-02-19 08:00:46,991 INFO [RS:0;jenkins-hbase4:46847] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46847%2C1676793643828.meta:.meta(num 1676793644369) 2023-02-19 08:00:46,994 DEBUG [RS:0;jenkins-hbase4:46847] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/oldWALs 2023-02-19 08:00:46,994 INFO [RS:0;jenkins-hbase4:46847] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46847%2C1676793643828:(num 1676793645153) 2023-02-19 08:00:46,994 DEBUG [RS:0;jenkins-hbase4:46847] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:46,994 INFO [RS:0;jenkins-hbase4:46847] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:46,994 INFO [RS:0;jenkins-hbase4:46847] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:46,994 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:46,995 INFO [RS:0;jenkins-hbase4:46847] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46847 2023-02-19 08:00:47,002 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46847,1676793643828 2023-02-19 08:00:47,002 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:47,002 ERROR [Listener at localhost/46631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@292d964e rejected from java.util.concurrent.ThreadPoolExecutor@2d1217b3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:47,003 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46847,1676793643828] 2023-02-19 08:00:47,003 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46847,1676793643828; numProcessing=2 2023-02-19 08:00:47,004 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46847,1676793643828 already deleted, retry=false 2023-02-19 08:00:47,004 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46847,1676793643828 expired; onlineServers=0 2023-02-19 08:00:47,004 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41783,1676793643780' ***** 2023-02-19 08:00:47,004 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 08:00:47,005 DEBUG [M:0;jenkins-hbase4:41783] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21ad412a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:47,005 INFO [M:0;jenkins-hbase4:41783] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41783,1676793643780 2023-02-19 08:00:47,005 INFO [M:0;jenkins-hbase4:41783] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41783,1676793643780; all regions closed. 2023-02-19 08:00:47,005 DEBUG [M:0;jenkins-hbase4:41783] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:47,005 DEBUG [M:0;jenkins-hbase4:41783] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 08:00:47,005 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 08:00:47,005 DEBUG [M:0;jenkins-hbase4:41783] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 08:00:47,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793644026] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793644026,5,FailOnTimeoutGroup] 2023-02-19 08:00:47,005 INFO [M:0;jenkins-hbase4:41783] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 08:00:47,006 INFO [M:0;jenkins-hbase4:41783] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 08:00:47,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793644026] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793644026,5,FailOnTimeoutGroup] 2023-02-19 08:00:47,006 INFO [M:0;jenkins-hbase4:41783] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 08:00:47,007 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:47,007 DEBUG [M:0;jenkins-hbase4:41783] master.HMaster(1512): Stopping service threads 2023-02-19 08:00:47,007 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:47,007 INFO [M:0;jenkins-hbase4:41783] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 08:00:47,007 ERROR [M:0;jenkins-hbase4:41783] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 08:00:47,007 INFO [M:0;jenkins-hbase4:41783] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 08:00:47,007 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 08:00:47,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:47,008 DEBUG [M:0;jenkins-hbase4:41783] zookeeper.ZKUtil(398): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 08:00:47,008 WARN [M:0;jenkins-hbase4:41783] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 08:00:47,008 INFO [M:0;jenkins-hbase4:41783] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 08:00:47,008 INFO [M:0;jenkins-hbase4:41783] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 08:00:47,008 DEBUG [M:0;jenkins-hbase4:41783] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:47,008 INFO [M:0;jenkins-hbase4:41783] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:47,008 DEBUG [M:0;jenkins-hbase4:41783] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:47,008 DEBUG [M:0;jenkins-hbase4:41783] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:47,008 DEBUG [M:0;jenkins-hbase4:41783] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:47,009 INFO [M:0;jenkins-hbase4:41783] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.12 KB heapSize=67.06 KB 2023-02-19 08:00:47,017 INFO [M:0;jenkins-hbase4:41783] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.12 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7e95435e84114ef4b9b4866b6315248a 2023-02-19 08:00:47,020 DEBUG [M:0;jenkins-hbase4:41783] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7e95435e84114ef4b9b4866b6315248a as hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7e95435e84114ef4b9b4866b6315248a 2023-02-19 08:00:47,024 INFO [M:0;jenkins-hbase4:41783] regionserver.HStore(1080): Added hdfs://localhost:35565/user/jenkins/test-data/2a8e60f6-b0cc-0a16-1d0d-e74d89206c5b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7e95435e84114ef4b9b4866b6315248a, entries=17, sequenceid=132, filesize=8.7 K 2023-02-19 08:00:47,024 INFO [M:0;jenkins-hbase4:41783] regionserver.HRegion(2947): Finished flush of dataSize ~56.12 KB/57462, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=132, compaction requested=false 2023-02-19 08:00:47,025 INFO [M:0;jenkins-hbase4:41783] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:47,025 DEBUG [M:0;jenkins-hbase4:41783] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:47,027 INFO [M:0;jenkins-hbase4:41783] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 08:00:47,027 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:47,028 INFO [M:0;jenkins-hbase4:41783] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41783 2023-02-19 08:00:47,031 DEBUG [M:0;jenkins-hbase4:41783] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41783,1676793643780 already deleted, retry=false 2023-02-19 08:00:47,274 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:47,274 INFO [M:0;jenkins-hbase4:41783] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41783,1676793643780; zookeeper connection closed. 2023-02-19 08:00:47,274 ERROR [Listener at localhost/46631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22e2cd8c rejected from java.util.concurrent.ThreadPoolExecutor@26dd5d08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:47,275 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): master:41783-0x1006b986cb60000, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:47,275 ERROR [Listener at localhost/46631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@664cbb42 rejected from java.util.concurrent.ThreadPoolExecutor@26dd5d08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:47,374 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:47,374 ERROR [Listener at localhost/46631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ce8f9d0 rejected from java.util.concurrent.ThreadPoolExecutor@2d1217b3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:47,374 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:46847-0x1006b986cb60001, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:47,374 INFO [RS:0;jenkins-hbase4:46847] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46847,1676793643828; zookeeper connection closed. 2023-02-19 08:00:47,374 ERROR [Listener at localhost/46631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6420a8ff rejected from java.util.concurrent.ThreadPoolExecutor@2d1217b3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:47,375 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@30a1f32a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@30a1f32a 2023-02-19 08:00:47,474 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:47,474 INFO [RS:1;jenkins-hbase4:36267] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36267,1676793643862; zookeeper connection closed. 2023-02-19 08:00:47,474 ERROR [Listener at localhost/46631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74188d61 rejected from java.util.concurrent.ThreadPoolExecutor@83012a6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:47,474 DEBUG [Listener at localhost/46631-EventThread] zookeeper.ZKWatcher(600): regionserver:36267-0x1006b986cb60002, quorum=127.0.0.1:62679, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:47,474 ERROR [Listener at localhost/46631-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b956ae6 rejected from java.util.concurrent.ThreadPoolExecutor@83012a6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:47,474 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3b819e4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3b819e4 2023-02-19 08:00:47,475 INFO [Listener at localhost/46631] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 08:00:47,476 WARN [Listener at localhost/46631] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:47,479 INFO [Listener at localhost/46631] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:47,586 WARN [BP-504983048-172.31.14.131-1676793642684 heartbeating to localhost/127.0.0.1:35565] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:47,586 WARN [BP-504983048-172.31.14.131-1676793642684 heartbeating to localhost/127.0.0.1:35565] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-504983048-172.31.14.131-1676793642684 (Datanode Uuid 5ae67b89-4fcc-4498-a7b9-d23d0d83c236) service to localhost/127.0.0.1:35565 2023-02-19 08:00:47,587 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/cluster_97522d0d-516b-9cba-d02d-426c55acf997/dfs/data/data3/current/BP-504983048-172.31.14.131-1676793642684] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:47,587 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/cluster_97522d0d-516b-9cba-d02d-426c55acf997/dfs/data/data4/current/BP-504983048-172.31.14.131-1676793642684] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:47,588 WARN [Listener at localhost/46631] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:47,591 INFO [Listener at localhost/46631] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:47,592 WARN [2004994183@qtp-859725841-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40245] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-02-19 08:00:47,592 WARN [2004994183@qtp-859725841-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40245] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-02-19 08:00:47,695 WARN [BP-504983048-172.31.14.131-1676793642684 heartbeating to localhost/127.0.0.1:35565] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:47,695 WARN [BP-504983048-172.31.14.131-1676793642684 heartbeating to localhost/127.0.0.1:35565] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-504983048-172.31.14.131-1676793642684 (Datanode Uuid 2687e268-43e2-4935-a181-e3e6972dd593) service to localhost/127.0.0.1:35565 2023-02-19 08:00:47,696 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/cluster_97522d0d-516b-9cba-d02d-426c55acf997/dfs/data/data1/current/BP-504983048-172.31.14.131-1676793642684] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:47,696 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/cluster_97522d0d-516b-9cba-d02d-426c55acf997/dfs/data/data2/current/BP-504983048-172.31.14.131-1676793642684] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:47,705 INFO [Listener at localhost/46631] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:47,818 INFO [Listener at localhost/46631] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 08:00:47,837 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 08:00:47,850 INFO [Listener at localhost/46631] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=255 (was 230) Potentially hanging thread: (jenkins-hbase4.apache.org,41783,1676793643780)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:35565 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35565 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35565 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:35565 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35565 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35565 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46631 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46631.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35565 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=655 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=359 (was 381), ProcessCount=170 (was 170), AvailableMemoryMB=9132 (was 9173) 2023-02-19 08:00:47,861 INFO [Listener at localhost/46631] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=255, OpenFileDescriptor=655, MaxFileDescriptor=60000, SystemLoadAverage=359, ProcessCount=170, AvailableMemoryMB=9132 2023-02-19 08:00:47,871 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/hadoop.log.dir so I do NOT create it in target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c 2023-02-19 08:00:47,871 WARN [Listener at localhost/46631] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 08:00:47,871 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/hadoop.tmp.dir so I do NOT create it in target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c 2023-02-19 08:00:47,871 WARN [Listener at localhost/46631] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90e6ad27-ee57-0160-ebbe-6694f305a12c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 08:00:47,871 DEBUG [Listener at localhost/46631] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c 2023-02-19 08:00:47,871 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 08:00:47,872 INFO [Listener at localhost/46631] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/cluster_4d70f698-dcec-8638-417b-52ee29f45a44, deleteOnExit=true 2023-02-19 08:00:47,872 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 08:00:47,872 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/test.cache.data in system properties and HBase conf 2023-02-19 08:00:47,872 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 08:00:47,872 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/hadoop.log.dir in system properties and HBase conf 2023-02-19 08:00:47,872 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 08:00:47,872 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 08:00:47,872 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 08:00:47,872 DEBUG [Listener at localhost/46631] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/nfs.dump.dir in system properties and HBase conf 2023-02-19 08:00:47,873 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/java.io.tmpdir in system properties and HBase conf 2023-02-19 08:00:47,874 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:47,874 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 08:00:47,874 INFO [Listener at localhost/46631] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 08:00:47,878 WARN [Listener at localhost/46631] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:47,878 WARN [Listener at localhost/46631] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:47,916 WARN [Listener at localhost/46631] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:47,919 INFO [Listener at localhost/46631] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:47,924 INFO [Listener at localhost/46631] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/java.io.tmpdir/Jetty_localhost_38107_hdfs____.ueyc4j/webapp 2023-02-19 08:00:48,017 INFO [Listener at localhost/46631] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38107 2023-02-19 08:00:48,021 WARN [Listener at localhost/46631] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:48,021 WARN [Listener at localhost/46631] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:48,111 WARN [Listener at localhost/38205] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:48,125 WARN [Listener at localhost/38205] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:48,127 WARN [Listener at localhost/38205] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:48,129 INFO [Listener at localhost/38205] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:48,134 INFO [Listener at localhost/38205] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/java.io.tmpdir/Jetty_localhost_46109_datanode____ers5r3/webapp 2023-02-19 08:00:48,230 INFO [Listener at localhost/38205] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46109 2023-02-19 08:00:48,240 WARN [Listener at localhost/39173] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:48,255 WARN [Listener at localhost/39173] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:48,257 WARN [Listener at localhost/39173] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:48,258 INFO [Listener at localhost/39173] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:48,262 INFO [Listener at localhost/39173] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/java.io.tmpdir/Jetty_localhost_46787_datanode____.yvp9id/webapp 2023-02-19 08:00:48,350 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2cf8525300c57da: Processing first storage report for DS-f403fa4f-a1cc-4ad0-8273-9a2d6ba1b91c from datanode 1a2766f4-b8ed-4574-bbc1-7b0d5ab925a7 2023-02-19 08:00:48,351 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2cf8525300c57da: from storage DS-f403fa4f-a1cc-4ad0-8273-9a2d6ba1b91c node DatanodeRegistration(127.0.0.1:39349, datanodeUuid=1a2766f4-b8ed-4574-bbc1-7b0d5ab925a7, infoPort=33575, infoSecurePort=0, ipcPort=39173, storageInfo=lv=-57;cid=testClusterID;nsid=1704918703;c=1676793647881), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-19 08:00:48,351 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2cf8525300c57da: Processing first storage report for DS-77ff6bda-56aa-46eb-8aa8-5b37ee5192ab from datanode 1a2766f4-b8ed-4574-bbc1-7b0d5ab925a7 2023-02-19 08:00:48,351 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2cf8525300c57da: from storage DS-77ff6bda-56aa-46eb-8aa8-5b37ee5192ab node DatanodeRegistration(127.0.0.1:39349, datanodeUuid=1a2766f4-b8ed-4574-bbc1-7b0d5ab925a7, infoPort=33575, infoSecurePort=0, ipcPort=39173, storageInfo=lv=-57;cid=testClusterID;nsid=1704918703;c=1676793647881), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:48,372 INFO [Listener at localhost/39173] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46787 2023-02-19 08:00:48,380 WARN [Listener at localhost/41625] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:48,466 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28d796c54264fb91: Processing first storage report for DS-153c9536-0d8b-4be9-a53c-85af3b7eedbc from datanode 0ecbb181-ee9d-47f2-9208-be669eb0cedd 2023-02-19 08:00:48,466 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28d796c54264fb91: from storage DS-153c9536-0d8b-4be9-a53c-85af3b7eedbc node DatanodeRegistration(127.0.0.1:38405, datanodeUuid=0ecbb181-ee9d-47f2-9208-be669eb0cedd, infoPort=32911, infoSecurePort=0, ipcPort=41625, storageInfo=lv=-57;cid=testClusterID;nsid=1704918703;c=1676793647881), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:48,466 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28d796c54264fb91: Processing first storage report for DS-e34a8719-a122-4782-a56b-8aae1735eaf5 from datanode 0ecbb181-ee9d-47f2-9208-be669eb0cedd 2023-02-19 08:00:48,466 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28d796c54264fb91: from storage DS-e34a8719-a122-4782-a56b-8aae1735eaf5 node DatanodeRegistration(127.0.0.1:38405, datanodeUuid=0ecbb181-ee9d-47f2-9208-be669eb0cedd, infoPort=32911, infoSecurePort=0, ipcPort=41625, storageInfo=lv=-57;cid=testClusterID;nsid=1704918703;c=1676793647881), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:48,485 DEBUG [Listener at localhost/41625] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c 2023-02-19 08:00:48,487 INFO [Listener at localhost/41625] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/cluster_4d70f698-dcec-8638-417b-52ee29f45a44/zookeeper_0, clientPort=64685, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/cluster_4d70f698-dcec-8638-417b-52ee29f45a44/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/cluster_4d70f698-dcec-8638-417b-52ee29f45a44/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 08:00:48,488 INFO [Listener at localhost/41625] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64685 2023-02-19 08:00:48,488 INFO [Listener at localhost/41625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,489 INFO [Listener at localhost/41625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,502 INFO [Listener at localhost/41625] util.FSUtils(479): Created version file at hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a with version=8 2023-02-19 08:00:48,502 INFO [Listener at localhost/41625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,503 INFO [Listener at localhost/41625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,503 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38205/user/jenkins/test-data/45f74e64-5adb-e00c-29ba-447066fc2d1b/hbase-staging 2023-02-19 08:00:48,505 INFO [Listener at localhost/41625] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:48,505 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:48,505 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:48,505 INFO [Listener at localhost/41625] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:48,506 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:48,506 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:48,506 INFO [Listener at localhost/41625] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:48,507 INFO [Listener at localhost/41625] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35723 2023-02-19 08:00:48,507 INFO [Listener at localhost/41625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,508 INFO [Listener at localhost/41625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,508 INFO [Listener at localhost/41625] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35723 connecting to ZooKeeper ensemble=127.0.0.1:64685 2023-02-19 08:00:48,514 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:357230x0, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:48,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35723-0x1006b987f2c0000 connected 2023-02-19 08:00:48,530 DEBUG [Listener at localhost/41625] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:48,530 DEBUG [Listener at localhost/41625] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:48,530 DEBUG [Listener at localhost/41625] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:48,531 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35723 2023-02-19 08:00:48,531 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35723 2023-02-19 08:00:48,531 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35723 2023-02-19 08:00:48,531 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35723 2023-02-19 08:00:48,531 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35723 2023-02-19 08:00:48,532 INFO [Listener at localhost/41625] master.HMaster(444): hbase.rootdir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a, hbase.cluster.distributed=false 2023-02-19 08:00:48,543 INFO [Listener at localhost/41625] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:48,543 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:48,543 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:48,543 INFO [Listener at localhost/41625] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:48,543 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:48,543 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:48,544 INFO [Listener at localhost/41625] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:48,544 INFO [Listener at localhost/41625] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42909 2023-02-19 08:00:48,544 INFO [Listener at localhost/41625] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:48,545 DEBUG [Listener at localhost/41625] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:48,545 INFO [Listener at localhost/41625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,546 INFO [Listener at localhost/41625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,547 INFO [Listener at localhost/41625] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42909 connecting to ZooKeeper ensemble=127.0.0.1:64685 2023-02-19 08:00:48,549 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:429090x0, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:48,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42909-0x1006b987f2c0001 connected 2023-02-19 08:00:48,550 DEBUG [Listener at localhost/41625] zookeeper.ZKUtil(164): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:48,550 DEBUG [Listener at localhost/41625] zookeeper.ZKUtil(164): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:48,551 DEBUG [Listener at localhost/41625] zookeeper.ZKUtil(164): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:48,551 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42909 2023-02-19 08:00:48,551 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42909 2023-02-19 08:00:48,551 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42909 2023-02-19 08:00:48,552 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42909 2023-02-19 08:00:48,552 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42909 2023-02-19 08:00:48,562 INFO [Listener at localhost/41625] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:48,562 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:48,562 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:48,562 INFO [Listener at localhost/41625] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:48,562 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:48,562 INFO [Listener at localhost/41625] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:48,562 INFO [Listener at localhost/41625] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:48,563 INFO [Listener at localhost/41625] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45395 2023-02-19 08:00:48,563 INFO [Listener at localhost/41625] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:48,564 DEBUG [Listener at localhost/41625] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:48,564 INFO [Listener at localhost/41625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,565 INFO [Listener at localhost/41625] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,566 INFO [Listener at localhost/41625] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45395 connecting to ZooKeeper ensemble=127.0.0.1:64685 2023-02-19 08:00:48,569 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:453950x0, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:48,569 DEBUG [Listener at localhost/41625] zookeeper.ZKUtil(164): regionserver:453950x0, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:48,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45395-0x1006b987f2c0002 connected 2023-02-19 08:00:48,570 DEBUG [Listener at localhost/41625] zookeeper.ZKUtil(164): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:48,571 DEBUG [Listener at localhost/41625] zookeeper.ZKUtil(164): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:48,571 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45395 2023-02-19 08:00:48,571 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45395 2023-02-19 08:00:48,572 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45395 2023-02-19 08:00:48,572 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45395 2023-02-19 08:00:48,572 DEBUG [Listener at localhost/41625] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45395 2023-02-19 08:00:48,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35723,1676793648505 2023-02-19 08:00:48,575 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:48,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35723,1676793648505 2023-02-19 08:00:48,576 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:48,576 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:48,576 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:48,576 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:48,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:48,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35723,1676793648505 from backup master directory 2023-02-19 08:00:48,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:48,580 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35723,1676793648505 2023-02-19 08:00:48,580 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:48,580 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:48,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35723,1676793648505 2023-02-19 08:00:48,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/hbase.id with ID: c9796961-c4ea-4f0d-81d3-b348a0076956 2023-02-19 08:00:48,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:48,599 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:48,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x52372577 to 127.0.0.1:64685 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:48,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@483d43c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:48,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:48,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 08:00:48,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:48,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/data/master/store-tmp 2023-02-19 08:00:48,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:48,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:48,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:48,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:48,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:48,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:48,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:48,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:48,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/WALs/jenkins-hbase4.apache.org,35723,1676793648505 2023-02-19 08:00:48,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35723%2C1676793648505, suffix=, logDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/WALs/jenkins-hbase4.apache.org,35723,1676793648505, archiveDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/oldWALs, maxLogs=10 2023-02-19 08:00:48,635 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39349,DS-f403fa4f-a1cc-4ad0-8273-9a2d6ba1b91c,DISK] 2023-02-19 08:00:48,635 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-153c9536-0d8b-4be9-a53c-85af3b7eedbc,DISK] 2023-02-19 08:00:48,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/WALs/jenkins-hbase4.apache.org,35723,1676793648505/jenkins-hbase4.apache.org%2C35723%2C1676793648505.1676793648619 2023-02-19 08:00:48,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39349,DS-f403fa4f-a1cc-4ad0-8273-9a2d6ba1b91c,DISK], DatanodeInfoWithStorage[127.0.0.1:38405,DS-153c9536-0d8b-4be9-a53c-85af3b7eedbc,DISK]] 2023-02-19 08:00:48,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:48,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:48,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:48,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:48,640 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:48,642 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 08:00:48,642 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 08:00:48,642 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:48,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:48,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:48,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:48,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:48,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69182106, jitterRate=0.030893713235855103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:48,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:48,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 08:00:48,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 08:00:48,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 08:00:48,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 08:00:48,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 08:00:48,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 08:00:48,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 08:00:48,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 08:00:48,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 08:00:48,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 08:00:48,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 08:00:48,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 08:00:48,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 08:00:48,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 08:00:48,675 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:48,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 08:00:48,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 08:00:48,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 08:00:48,680 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:48,680 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:48,680 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:48,680 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:48,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35723,1676793648505, sessionid=0x1006b987f2c0000, setting cluster-up flag (Was=false) 2023-02-19 08:00:48,692 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:48,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 08:00:48,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35723,1676793648505 2023-02-19 08:00:48,701 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:48,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 08:00:48,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35723,1676793648505 2023-02-19 08:00:48,710 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.hbase-snapshot/.tmp 2023-02-19 08:00:48,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:48,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:48,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:48,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:48,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:48,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 08:00:48,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:48,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676793678736 2023-02-19 08:00:48,736 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:48,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 08:00:48,736 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 08:00:48,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 08:00:48,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 08:00:48,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 08:00:48,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 08:00:48,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 08:00:48,737 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:48,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 08:00:48,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 08:00:48,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 08:00:48,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 08:00:48,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 08:00:48,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793648768,5,FailOnTimeoutGroup] 2023-02-19 08:00:48,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793648770,5,FailOnTimeoutGroup] 2023-02-19 08:00:48,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 08:00:48,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,773 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:48,774 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:48,774 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a 2023-02-19 08:00:48,777 INFO [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(952): ClusterId : c9796961-c4ea-4f0d-81d3-b348a0076956 2023-02-19 08:00:48,777 INFO [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(952): ClusterId : c9796961-c4ea-4f0d-81d3-b348a0076956 2023-02-19 08:00:48,777 DEBUG [RS:1;jenkins-hbase4:45395] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:48,777 DEBUG [RS:0;jenkins-hbase4:42909] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:48,779 DEBUG [RS:1;jenkins-hbase4:45395] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:48,779 DEBUG [RS:1;jenkins-hbase4:45395] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:48,779 DEBUG [RS:0;jenkins-hbase4:42909] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:48,779 DEBUG [RS:0;jenkins-hbase4:42909] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:48,783 DEBUG [RS:1;jenkins-hbase4:45395] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:48,784 DEBUG [RS:0;jenkins-hbase4:42909] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:48,784 DEBUG [RS:1;jenkins-hbase4:45395] zookeeper.ReadOnlyZKClient(139): Connect 0x0252da6f to 127.0.0.1:64685 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:48,785 DEBUG [RS:0;jenkins-hbase4:42909] zookeeper.ReadOnlyZKClient(139): Connect 0x7ed701f5 to 127.0.0.1:64685 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:48,796 DEBUG [RS:1;jenkins-hbase4:45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c953455, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:48,797 DEBUG [RS:1;jenkins-hbase4:45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8aab11f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:48,800 DEBUG [RS:0;jenkins-hbase4:42909] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7010e05f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:48,800 DEBUG [RS:0;jenkins-hbase4:42909] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@742f6a85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:48,809 DEBUG [RS:0;jenkins-hbase4:42909] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42909 2023-02-19 08:00:48,809 INFO [RS:0;jenkins-hbase4:42909] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:48,809 INFO [RS:0;jenkins-hbase4:42909] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:48,809 DEBUG [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:48,810 INFO [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35723,1676793648505 with isa=jenkins-hbase4.apache.org/172.31.14.131:42909, startcode=1676793648543 2023-02-19 08:00:48,810 DEBUG [RS:0;jenkins-hbase4:42909] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:48,811 DEBUG [RS:1;jenkins-hbase4:45395] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45395 2023-02-19 08:00:48,811 INFO [RS:1;jenkins-hbase4:45395] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:48,811 INFO [RS:1;jenkins-hbase4:45395] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:48,811 DEBUG [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:48,811 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50585, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:48,812 INFO [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35723,1676793648505 with isa=jenkins-hbase4.apache.org/172.31.14.131:45395, startcode=1676793648562 2023-02-19 08:00:48,812 DEBUG [RS:1;jenkins-hbase4:45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:48,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:48,815 DEBUG [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a 2023-02-19 08:00:48,815 DEBUG [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38205 2023-02-19 08:00:48,815 DEBUG [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:48,816 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:48,817 DEBUG [RS:0;jenkins-hbase4:42909] zookeeper.ZKUtil(162): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:48,817 WARN [RS:0;jenkins-hbase4:42909] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:48,817 INFO [RS:0;jenkins-hbase4:42909] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:48,817 DEBUG [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/WALs/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:48,823 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42909,1676793648543] 2023-02-19 08:00:48,824 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54637, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:48,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:48,825 DEBUG [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a 2023-02-19 08:00:48,825 DEBUG [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38205 2023-02-19 08:00:48,825 DEBUG [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:48,825 DEBUG [RS:0;jenkins-hbase4:42909] zookeeper.ZKUtil(162): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:48,829 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:48,829 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:48,830 DEBUG [RS:1;jenkins-hbase4:45395] zookeeper.ZKUtil(162): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:48,830 WARN [RS:1;jenkins-hbase4:45395] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:48,830 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45395,1676793648562] 2023-02-19 08:00:48,830 INFO [RS:1;jenkins-hbase4:45395] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:48,830 DEBUG [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/WALs/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:48,830 DEBUG [RS:0;jenkins-hbase4:42909] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:48,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:48,830 INFO [RS:0;jenkins-hbase4:42909] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:48,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:48,834 DEBUG [RS:1;jenkins-hbase4:45395] zookeeper.ZKUtil(162): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:48,834 DEBUG [RS:1;jenkins-hbase4:45395] zookeeper.ZKUtil(162): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:48,835 DEBUG [RS:1;jenkins-hbase4:45395] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:48,835 INFO [RS:1;jenkins-hbase4:45395] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:48,837 INFO [RS:0;jenkins-hbase4:42909] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:48,840 INFO [RS:1;jenkins-hbase4:45395] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:48,840 INFO [RS:0;jenkins-hbase4:42909] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:48,840 INFO [RS:0;jenkins-hbase4:42909] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,841 INFO [RS:1;jenkins-hbase4:45395] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:48,842 INFO [RS:1;jenkins-hbase4:45395] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,844 INFO [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:48,845 INFO [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:48,846 INFO [RS:0;jenkins-hbase4:42909] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,846 INFO [RS:1;jenkins-hbase4:45395] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,846 DEBUG [RS:0;jenkins-hbase4:42909] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:0;jenkins-hbase4:42909] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:1;jenkins-hbase4:45395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:0;jenkins-hbase4:42909] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:1;jenkins-hbase4:45395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:0;jenkins-hbase4:42909] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:1;jenkins-hbase4:45395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:0;jenkins-hbase4:42909] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:1;jenkins-hbase4:45395] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:0;jenkins-hbase4:42909] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:48,847 DEBUG [RS:1;jenkins-hbase4:45395] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:0;jenkins-hbase4:42909] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:1;jenkins-hbase4:45395] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:48,847 DEBUG [RS:0;jenkins-hbase4:42909] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:1;jenkins-hbase4:45395] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:0;jenkins-hbase4:42909] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:1;jenkins-hbase4:45395] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:0;jenkins-hbase4:42909] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:1;jenkins-hbase4:45395] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,847 DEBUG [RS:1;jenkins-hbase4:45395] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:48,853 INFO [RS:0;jenkins-hbase4:42909] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,853 INFO [RS:0;jenkins-hbase4:42909] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,853 INFO [RS:0;jenkins-hbase4:42909] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,853 INFO [RS:1;jenkins-hbase4:45395] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,853 INFO [RS:1;jenkins-hbase4:45395] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,855 INFO [RS:1;jenkins-hbase4:45395] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,866 INFO [RS:0;jenkins-hbase4:42909] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:48,866 INFO [RS:0;jenkins-hbase4:42909] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42909,1676793648543-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,869 INFO [RS:1;jenkins-hbase4:45395] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:48,869 INFO [RS:1;jenkins-hbase4:45395] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45395,1676793648562-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:48,878 INFO [RS:0;jenkins-hbase4:42909] regionserver.Replication(203): jenkins-hbase4.apache.org,42909,1676793648543 started 2023-02-19 08:00:48,878 INFO [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42909,1676793648543, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42909, sessionid=0x1006b987f2c0001 2023-02-19 08:00:48,878 DEBUG [RS:0;jenkins-hbase4:42909] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:48,878 DEBUG [RS:0;jenkins-hbase4:42909] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:48,878 DEBUG [RS:0;jenkins-hbase4:42909] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42909,1676793648543' 2023-02-19 08:00:48,878 DEBUG [RS:0;jenkins-hbase4:42909] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:48,879 DEBUG [RS:0;jenkins-hbase4:42909] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:48,879 DEBUG [RS:0;jenkins-hbase4:42909] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:48,879 DEBUG [RS:0;jenkins-hbase4:42909] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:48,879 DEBUG [RS:0;jenkins-hbase4:42909] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:48,879 DEBUG [RS:0;jenkins-hbase4:42909] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42909,1676793648543' 2023-02-19 08:00:48,879 DEBUG [RS:0;jenkins-hbase4:42909] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:48,879 DEBUG [RS:0;jenkins-hbase4:42909] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:48,880 DEBUG [RS:0;jenkins-hbase4:42909] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:48,880 INFO [RS:0;jenkins-hbase4:42909] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:48,880 INFO [RS:0;jenkins-hbase4:42909] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:48,884 INFO [RS:1;jenkins-hbase4:45395] regionserver.Replication(203): jenkins-hbase4.apache.org,45395,1676793648562 started 2023-02-19 08:00:48,884 INFO [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45395,1676793648562, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45395, sessionid=0x1006b987f2c0002 2023-02-19 08:00:48,884 DEBUG [RS:1;jenkins-hbase4:45395] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:48,884 DEBUG [RS:1;jenkins-hbase4:45395] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:48,884 DEBUG [RS:1;jenkins-hbase4:45395] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45395,1676793648562' 2023-02-19 08:00:48,884 DEBUG [RS:1;jenkins-hbase4:45395] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:48,884 DEBUG [RS:1;jenkins-hbase4:45395] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:48,885 DEBUG [RS:1;jenkins-hbase4:45395] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:48,885 DEBUG [RS:1;jenkins-hbase4:45395] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:48,885 DEBUG [RS:1;jenkins-hbase4:45395] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:48,885 DEBUG [RS:1;jenkins-hbase4:45395] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45395,1676793648562' 2023-02-19 08:00:48,885 DEBUG [RS:1;jenkins-hbase4:45395] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:48,885 DEBUG [RS:1;jenkins-hbase4:45395] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:48,885 DEBUG [RS:1;jenkins-hbase4:45395] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:48,885 INFO [RS:1;jenkins-hbase4:45395] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:48,885 INFO [RS:1;jenkins-hbase4:45395] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:49,203 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:49,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:49,205 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/info 2023-02-19 08:00:49,206 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:49,206 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:49,206 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:49,207 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:49,208 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:49,208 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:49,208 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:49,209 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/table 2023-02-19 08:00:49,209 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:49,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:49,210 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740 2023-02-19 08:00:49,210 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740 2023-02-19 08:00:49,212 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:49,213 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:49,215 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:49,215 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73608788, jitterRate=0.09685641527175903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:49,215 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:49,215 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:49,216 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:49,216 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:49,216 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:49,216 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:49,216 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:49,216 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:49,217 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:49,217 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 08:00:49,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 08:00:49,219 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 08:00:49,220 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 08:00:49,370 DEBUG [jenkins-hbase4:35723] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 08:00:49,371 DEBUG [jenkins-hbase4:35723] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:49,372 DEBUG [jenkins-hbase4:35723] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:49,372 DEBUG [jenkins-hbase4:35723] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:49,372 DEBUG [jenkins-hbase4:35723] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:49,372 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45395,1676793648562, state=OPENING 2023-02-19 08:00:49,373 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 08:00:49,374 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:49,375 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:49,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45395,1676793648562}] 2023-02-19 08:00:49,529 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:49,529 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:49,530 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44422, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:49,533 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 08:00:49,534 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:49,535 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45395%2C1676793648562.meta, suffix=.meta, logDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/WALs/jenkins-hbase4.apache.org,45395,1676793648562, archiveDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/oldWALs, maxLogs=32 2023-02-19 08:00:49,547 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39349,DS-f403fa4f-a1cc-4ad0-8273-9a2d6ba1b91c,DISK] 2023-02-19 08:00:49,548 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-153c9536-0d8b-4be9-a53c-85af3b7eedbc,DISK] 2023-02-19 08:00:49,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/WALs/jenkins-hbase4.apache.org,45395,1676793648562/jenkins-hbase4.apache.org%2C45395%2C1676793648562.meta.1676793649535.meta 2023-02-19 08:00:49,550 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38405,DS-153c9536-0d8b-4be9-a53c-85af3b7eedbc,DISK], DatanodeInfoWithStorage[127.0.0.1:39349,DS-f403fa4f-a1cc-4ad0-8273-9a2d6ba1b91c,DISK]] 2023-02-19 08:00:49,550 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:49,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 08:00:49,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 08:00:49,551 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 08:00:49,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 08:00:49,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:49,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 08:00:49,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 08:00:49,552 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:49,553 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/info 2023-02-19 08:00:49,553 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/info 2023-02-19 08:00:49,553 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:49,553 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:49,554 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:49,554 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:49,554 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:49,554 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:49,555 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:49,555 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:49,555 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/table 2023-02-19 08:00:49,555 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/table 2023-02-19 08:00:49,556 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:49,556 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:49,557 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740 2023-02-19 08:00:49,557 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740 2023-02-19 08:00:49,559 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:49,559 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:49,560 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64094073, jitterRate=-0.04492388665676117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:49,560 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:49,561 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676793649529 2023-02-19 08:00:49,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 08:00:49,565 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 08:00:49,565 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45395,1676793648562, state=OPEN 2023-02-19 08:00:49,566 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 08:00:49,566 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:49,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 08:00:49,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45395,1676793648562 in 191 msec 2023-02-19 08:00:49,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 08:00:49,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 351 msec 2023-02-19 08:00:49,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 858 msec 2023-02-19 08:00:49,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676793649570, completionTime=-1 2023-02-19 08:00:49,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 08:00:49,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 08:00:49,573 DEBUG [hconnection-0x5ad4819c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:49,574 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:49,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 08:00:49,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676793709576 2023-02-19 08:00:49,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676793769576 2023-02-19 08:00:49,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-19 08:00:49,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35723,1676793648505-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:49,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35723,1676793648505-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:49,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35723,1676793648505-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:49,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35723, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:49,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:49,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 08:00:49,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:49,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 08:00:49,587 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 08:00:49,587 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:49,588 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:49,589 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:49,589 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2 empty. 2023-02-19 08:00:49,589 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:49,589 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 08:00:49,597 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:49,599 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 93fceff61dd40e8332efdd390346cbe2, NAME => 'hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp 2023-02-19 08:00:49,604 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:49,604 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 93fceff61dd40e8332efdd390346cbe2, disabling compactions & flushes 2023-02-19 08:00:49,604 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:49,604 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:49,604 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. after waiting 0 ms 2023-02-19 08:00:49,604 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:49,604 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:49,604 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 93fceff61dd40e8332efdd390346cbe2: 2023-02-19 08:00:49,606 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:49,606 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793649606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793649606"}]},"ts":"1676793649606"} 2023-02-19 08:00:49,608 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:49,608 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:49,608 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793649608"}]},"ts":"1676793649608"} 2023-02-19 08:00:49,609 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 08:00:49,612 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:49,613 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:49,613 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:49,613 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:49,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=93fceff61dd40e8332efdd390346cbe2, ASSIGN}] 2023-02-19 08:00:49,615 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=93fceff61dd40e8332efdd390346cbe2, ASSIGN 2023-02-19 08:00:49,616 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=93fceff61dd40e8332efdd390346cbe2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45395,1676793648562; forceNewPlan=false, retain=false 2023-02-19 08:00:49,766 INFO [jenkins-hbase4:35723] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:49,766 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=93fceff61dd40e8332efdd390346cbe2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:49,766 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793649766"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793649766"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793649766"}]},"ts":"1676793649766"} 2023-02-19 08:00:49,768 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 93fceff61dd40e8332efdd390346cbe2, server=jenkins-hbase4.apache.org,45395,1676793648562}] 2023-02-19 08:00:49,881 INFO [RS:0;jenkins-hbase4:42909] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42909%2C1676793648543, suffix=, logDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/WALs/jenkins-hbase4.apache.org,42909,1676793648543, archiveDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/oldWALs, maxLogs=32 2023-02-19 08:00:49,887 INFO [RS:1;jenkins-hbase4:45395] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45395%2C1676793648562, suffix=, logDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/WALs/jenkins-hbase4.apache.org,45395,1676793648562, archiveDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/oldWALs, maxLogs=32 2023-02-19 08:00:49,896 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-153c9536-0d8b-4be9-a53c-85af3b7eedbc,DISK] 2023-02-19 08:00:49,896 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39349,DS-f403fa4f-a1cc-4ad0-8273-9a2d6ba1b91c,DISK] 2023-02-19 08:00:49,896 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 08:00:49,902 INFO [RS:0;jenkins-hbase4:42909] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/WALs/jenkins-hbase4.apache.org,42909,1676793648543/jenkins-hbase4.apache.org%2C42909%2C1676793648543.1676793649881 2023-02-19 08:00:49,902 DEBUG [RS:0;jenkins-hbase4:42909] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38405,DS-153c9536-0d8b-4be9-a53c-85af3b7eedbc,DISK], DatanodeInfoWithStorage[127.0.0.1:39349,DS-f403fa4f-a1cc-4ad0-8273-9a2d6ba1b91c,DISK]] 2023-02-19 08:00:49,903 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39349,DS-f403fa4f-a1cc-4ad0-8273-9a2d6ba1b91c,DISK] 2023-02-19 08:00:49,903 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-153c9536-0d8b-4be9-a53c-85af3b7eedbc,DISK] 2023-02-19 08:00:49,907 INFO [RS:1;jenkins-hbase4:45395] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/WALs/jenkins-hbase4.apache.org,45395,1676793648562/jenkins-hbase4.apache.org%2C45395%2C1676793648562.1676793649887 2023-02-19 08:00:49,908 DEBUG [RS:1;jenkins-hbase4:45395] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39349,DS-f403fa4f-a1cc-4ad0-8273-9a2d6ba1b91c,DISK], DatanodeInfoWithStorage[127.0.0.1:38405,DS-153c9536-0d8b-4be9-a53c-85af3b7eedbc,DISK]] 2023-02-19 08:00:49,924 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:49,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 93fceff61dd40e8332efdd390346cbe2, NAME => 'hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:49,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:49,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:49,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:49,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:49,925 INFO [StoreOpener-93fceff61dd40e8332efdd390346cbe2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:49,927 DEBUG [StoreOpener-93fceff61dd40e8332efdd390346cbe2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2/info 2023-02-19 08:00:49,927 DEBUG [StoreOpener-93fceff61dd40e8332efdd390346cbe2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2/info 2023-02-19 08:00:49,927 INFO [StoreOpener-93fceff61dd40e8332efdd390346cbe2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93fceff61dd40e8332efdd390346cbe2 columnFamilyName info 2023-02-19 08:00:49,928 INFO [StoreOpener-93fceff61dd40e8332efdd390346cbe2-1] regionserver.HStore(310): Store=93fceff61dd40e8332efdd390346cbe2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:49,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:49,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:49,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:49,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:49,934 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 93fceff61dd40e8332efdd390346cbe2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67267391, jitterRate=0.0023622363805770874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:49,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 93fceff61dd40e8332efdd390346cbe2: 2023-02-19 08:00:49,934 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2., pid=6, masterSystemTime=1676793649920 2023-02-19 08:00:49,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:49,936 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:49,937 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=93fceff61dd40e8332efdd390346cbe2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:49,937 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793649937"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793649937"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793649937"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793649937"}]},"ts":"1676793649937"} 2023-02-19 08:00:49,939 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 08:00:49,939 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 93fceff61dd40e8332efdd390346cbe2, server=jenkins-hbase4.apache.org,45395,1676793648562 in 170 msec 2023-02-19 08:00:49,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 08:00:49,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=93fceff61dd40e8332efdd390346cbe2, ASSIGN in 326 msec 2023-02-19 08:00:49,942 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:49,942 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793649942"}]},"ts":"1676793649942"} 2023-02-19 08:00:49,946 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 08:00:49,949 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:49,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 364 msec 2023-02-19 08:00:49,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 08:00:49,989 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:49,989 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:49,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 08:00:50,007 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:50,015 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 08:00:50,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 24 msec 2023-02-19 08:00:50,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 08:00:50,037 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:50,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-19 08:00:50,054 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 08:00:50,057 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 08:00:50,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.477sec 2023-02-19 08:00:50,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 08:00:50,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 08:00:50,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 08:00:50,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35723,1676793648505-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 08:00:50,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35723,1676793648505-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 08:00:50,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 08:00:50,082 DEBUG [Listener at localhost/41625] zookeeper.ReadOnlyZKClient(139): Connect 0x24bcf5e9 to 127.0.0.1:64685 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:50,101 DEBUG [Listener at localhost/41625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@355499da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:50,103 DEBUG [hconnection-0x24d49ee1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:50,110 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44432, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:50,112 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35723,1676793648505 2023-02-19 08:00:50,113 DEBUG [Listener at localhost/41625] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 08:00:50,116 DEBUG [Listener at localhost/41625] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 08:00:50,117 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33560, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 08:00:50,118 INFO [Listener at localhost/41625] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:50,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:50,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 08:00:50,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 172.31.14.131:33560 deadline: 1676793710118, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:50,119 INFO [Listener at localhost/41625] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 08:00:50,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:50,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:50,124 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:50,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-19 08:00:50,125 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:50,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:50,127 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:50,127 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18 empty. 2023-02-19 08:00:50,127 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:50,127 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-19 08:00:50,156 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:50,157 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4dc10f3bf98c12a20160d15c35981d18, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp 2023-02-19 08:00:50,162 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:50,163 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 4dc10f3bf98c12a20160d15c35981d18, disabling compactions & flushes 2023-02-19 08:00:50,163 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:50,163 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:50,163 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. after waiting 0 ms 2023-02-19 08:00:50,163 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:50,163 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:50,163 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 4dc10f3bf98c12a20160d15c35981d18: 2023-02-19 08:00:50,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:50,165 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676793650165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793650165"}]},"ts":"1676793650165"} 2023-02-19 08:00:50,166 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:50,167 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:50,167 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793650167"}]},"ts":"1676793650167"} 2023-02-19 08:00:50,168 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-19 08:00:50,172 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:50,172 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:50,173 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:50,173 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:50,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=4dc10f3bf98c12a20160d15c35981d18, ASSIGN}] 2023-02-19 08:00:50,175 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=4dc10f3bf98c12a20160d15c35981d18, ASSIGN 2023-02-19 08:00:50,175 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=4dc10f3bf98c12a20160d15c35981d18, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42909,1676793648543; forceNewPlan=false, retain=false 2023-02-19 08:00:50,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:50,325 INFO [jenkins-hbase4:35723] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:50,325 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4dc10f3bf98c12a20160d15c35981d18, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,326 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676793650325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793650325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793650325"}]},"ts":"1676793650325"} 2023-02-19 08:00:50,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 4dc10f3bf98c12a20160d15c35981d18, server=jenkins-hbase4.apache.org,42909,1676793648543}] 2023-02-19 08:00:50,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:50,480 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,480 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:50,482 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58244, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:50,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:50,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4dc10f3bf98c12a20160d15c35981d18, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:50,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:50,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:50,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:50,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:50,486 INFO [StoreOpener-4dc10f3bf98c12a20160d15c35981d18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:50,487 DEBUG [StoreOpener-4dc10f3bf98c12a20160d15c35981d18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1 2023-02-19 08:00:50,487 DEBUG [StoreOpener-4dc10f3bf98c12a20160d15c35981d18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1 2023-02-19 08:00:50,487 INFO [StoreOpener-4dc10f3bf98c12a20160d15c35981d18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4dc10f3bf98c12a20160d15c35981d18 columnFamilyName f1 2023-02-19 08:00:50,487 INFO [StoreOpener-4dc10f3bf98c12a20160d15c35981d18-1] regionserver.HStore(310): Store=4dc10f3bf98c12a20160d15c35981d18/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:50,487 INFO [StoreOpener-4dc10f3bf98c12a20160d15c35981d18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:50,488 DEBUG [StoreOpener-4dc10f3bf98c12a20160d15c35981d18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2 2023-02-19 08:00:50,488 DEBUG [StoreOpener-4dc10f3bf98c12a20160d15c35981d18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2 2023-02-19 08:00:50,489 INFO [StoreOpener-4dc10f3bf98c12a20160d15c35981d18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4dc10f3bf98c12a20160d15c35981d18 columnFamilyName f2 2023-02-19 08:00:50,489 INFO [StoreOpener-4dc10f3bf98c12a20160d15c35981d18-1] regionserver.HStore(310): Store=4dc10f3bf98c12a20160d15c35981d18/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:50,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:50,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:50,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:50,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:50,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:50,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4dc10f3bf98c12a20160d15c35981d18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73694842, jitterRate=0.0981387197971344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:50,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4dc10f3bf98c12a20160d15c35981d18: 2023-02-19 08:00:50,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18., pid=12, masterSystemTime=1676793650480 2023-02-19 08:00:50,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:50,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:50,501 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4dc10f3bf98c12a20160d15c35981d18, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,501 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676793650501"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793650501"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793650501"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793650501"}]},"ts":"1676793650501"} 2023-02-19 08:00:50,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 08:00:50,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 4dc10f3bf98c12a20160d15c35981d18, server=jenkins-hbase4.apache.org,42909,1676793648543 in 176 msec 2023-02-19 08:00:50,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 08:00:50,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=4dc10f3bf98c12a20160d15c35981d18, ASSIGN in 334 msec 2023-02-19 08:00:50,510 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:50,511 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793650511"}]},"ts":"1676793650511"} 2023-02-19 08:00:50,512 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-19 08:00:50,515 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:50,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 393 msec 2023-02-19 08:00:50,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:50,730 INFO [Listener at localhost/41625] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-19 08:00:50,731 DEBUG [Listener at localhost/41625] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-19 08:00:50,731 INFO [Listener at localhost/41625] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:50,733 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-19 08:00:50,733 INFO [Listener at localhost/41625] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:50,733 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-19 08:00:50,733 INFO [Listener at localhost/41625] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 08:00:50,746 DEBUG [hconnection-0x24d49ee1-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:50,759 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58260, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:50,768 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42909] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:50,857 INFO [Listener at localhost/41625] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 08:00:50,857 INFO [Listener at localhost/41625] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 08:00:50,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-19 08:00:50,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676793650858 (current time:1676793650858). 2023-02-19 08:00:50,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 08:00:50,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] zookeeper.ReadOnlyZKClient(139): Connect 0x2f40ed47 to 127.0.0.1:64685 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:50,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4497e945, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:50,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:50,865 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:50,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f40ed47 to 127.0.0.1:64685 2023-02-19 08:00:50,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:50,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 08:00:50,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-19 08:00:50,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-19 08:00:50,869 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-19 08:00:50,869 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676794250869 2023-02-19 08:00:50,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-19 08:00:50,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:50,871 DEBUG [Listener at localhost/41625] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:50,871 DEBUG [Listener at localhost/41625] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 08:00:50,871 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-19 08:00:50,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-19 08:00:50,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-19 08:00:50,873 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-19 08:00:50,873 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676794250873 2023-02-19 08:00:50,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-19 08:00:50,880 INFO [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-19 08:00:50,880 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:50,881 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-19 08:00:50,881 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-19 08:00:50,881 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,881 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-19 08:00:50,882 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:50,882 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:50,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:50,882 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:50,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:50,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:50,882 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,882 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:50,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 08:00:50,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-19 08:00:50,884 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 08:00:50,884 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:50,884 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-19 08:00:50,884 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:50,884 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 08:00:50,885 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-19 08:00:50,885 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 08:00:50,885 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-19 08:00:50,885 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45395,1676793648562' joining acquired barrier for procedure (foo) in zk 2023-02-19 08:00:50,885 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42909,1676793648543' joining acquired barrier for procedure (foo) in zk 2023-02-19 08:00:50,886 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,886 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:50,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:50,888 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,888 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,888 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:50,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:50,888 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,888 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:50,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:50,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:50,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:50,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:50,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42909,1676793648543' joining acquired barrier for procedure 'foo' on coordinator 2023-02-19 08:00:50,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e38f830[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:50,889 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-19 08:00:50,889 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,891 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,891 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,891 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 08:00:50,891 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-19 08:00:50,891 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 08:00:50,891 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45395,1676793648562' in zk 2023-02-19 08:00:50,891 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,891 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:50,891 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 08:00:50,891 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:50,891 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 08:00:50,891 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. started... 2023-02-19 08:00:50,891 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4dc10f3bf98c12a20160d15c35981d18 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 08:00:50,892 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 08:00:50,892 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:50,892 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 08:00:50,908 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/.tmp/f1/0ca9f1270f5d464297b40daf9aa4a434 2023-02-19 08:00:50,923 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/.tmp/f2/1f490126f8ab42e588f29ca789f6e5f5 2023-02-19 08:00:50,927 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/.tmp/f1/0ca9f1270f5d464297b40daf9aa4a434 as hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/0ca9f1270f5d464297b40daf9aa4a434 2023-02-19 08:00:50,930 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/0ca9f1270f5d464297b40daf9aa4a434, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 08:00:50,930 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/.tmp/f2/1f490126f8ab42e588f29ca789f6e5f5 as hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/1f490126f8ab42e588f29ca789f6e5f5 2023-02-19 08:00:50,933 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/1f490126f8ab42e588f29ca789f6e5f5, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 08:00:50,934 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 4dc10f3bf98c12a20160d15c35981d18 in 43ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:50,934 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 08:00:50,935 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4dc10f3bf98c12a20160d15c35981d18: 2023-02-19 08:00:50,935 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.' region-info for snapshot=foo 2023-02-19 08:00:50,935 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:50,935 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/0ca9f1270f5d464297b40daf9aa4a434] hfiles 2023-02-19 08:00:50,935 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/0ca9f1270f5d464297b40daf9aa4a434 for snapshot=foo 2023-02-19 08:00:50,935 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/1f490126f8ab42e588f29ca789f6e5f5] hfiles 2023-02-19 08:00:50,935 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/1f490126f8ab42e588f29ca789f6e5f5 for snapshot=foo 2023-02-19 08:00:50,940 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. completed. 2023-02-19 08:00:50,940 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:50,940 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 08:00:50,940 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 08:00:50,940 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,940 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-19 08:00:50,940 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,42909,1676793648543' in zk 2023-02-19 08:00:50,942 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,942 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-19 08:00:50,942 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:50,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:50,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:50,942 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-19 08:00:50,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:50,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:50,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:50,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:50,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:50,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:50,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:50,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,42909,1676793648543': 2023-02-19 08:00:50,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42909,1676793648543' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-19 08:00:50,945 INFO [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-19 08:00:50,945 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:50,945 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:50,945 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-19 08:00:50,945 INFO [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 08:00:50,952 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,952 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:50,952 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,953 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:50,953 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:50,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:50,953 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,954 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:50,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:50,955 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-19 08:00:50,955 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:50,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 08:00:50,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:50,961 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:50,961 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-19 08:00:50,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:50,961 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:50,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:50,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:50,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:50,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:50,961 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-19 08:00:50,962 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-19 08:00:50,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.hbase-snapshot/.tmp/foo 2023-02-19 08:00:50,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:50,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:50,971 DEBUG [Listener at localhost/41625] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:50,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-19 08:00:50,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:50,973 DEBUG [Listener at localhost/41625] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 08:00:50,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.hbase-snapshot/.tmp/foo to hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.hbase-snapshot/foo 2023-02-19 08:00:50,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-19 08:00:51,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.hbase-snapshot/.tmp/foo 2023-02-19 08:00:51,000 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.hbase-snapshot/.tmp/foo 2023-02-19 08:00:51,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676793650870Consolidate snapshot: foo at 1676793650961 (+91 ms)Loading Region manifests for foo at 1676793650961Writing data manifest for foo at 1676793650964 (+3 ms)Verifying snapshot: foo at 1676793650981 (+17 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676793650999 (+18 ms) 2023-02-19 08:00:51,002 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-19 08:00:51,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 131 msec 2023-02-19 08:00:51,173 DEBUG [Listener at localhost/41625] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:51,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-19 08:00:51,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 08:00:51,174 INFO [Listener at localhost/41625] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 08:00:51,178 INFO [Listener at localhost/41625] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 08:00:51,183 INFO [Listener at localhost/41625] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 08:00:51,210 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42909] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,288 INFO [Listener at localhost/41625] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 08:00:51,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 08:00:51,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,295 INFO [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 08:00:51,295 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:51,296 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-19 08:00:51,296 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-19 08:00:51,296 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,296 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,298 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:51,298 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:51,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:51,298 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:51,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:51,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:51,298 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,298 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,300 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-19 08:00:51,300 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:51,300 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-19 08:00:51,300 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-19 08:00:51,300 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-19 08:00:51,300 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:51,301 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45395,1676793648562' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-19 08:00:51,301 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-19 08:00:51,302 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 08:00:51,302 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 08:00:51,302 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,302 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. started... 2023-02-19 08:00:51,302 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4dc10f3bf98c12a20160d15c35981d18 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 08:00:51,303 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,303 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,303 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:51,319 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/.tmp/f1/7abb6ad03b6e473481cf8ca503c842a2 2023-02-19 08:00:51,336 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/.tmp/f2/7011ccbb876e4c6bbb3263945eaba01f 2023-02-19 08:00:51,340 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/.tmp/f1/7abb6ad03b6e473481cf8ca503c842a2 as hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/7abb6ad03b6e473481cf8ca503c842a2 2023-02-19 08:00:51,343 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/7abb6ad03b6e473481cf8ca503c842a2, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 08:00:51,344 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/.tmp/f2/7011ccbb876e4c6bbb3263945eaba01f as hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/7011ccbb876e4c6bbb3263945eaba01f 2023-02-19 08:00:51,352 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/7011ccbb876e4c6bbb3263945eaba01f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 08:00:51,353 INFO [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 4dc10f3bf98c12a20160d15c35981d18 in 50ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:51,353 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4dc10f3bf98c12a20160d15c35981d18: 2023-02-19 08:00:51,353 DEBUG [rs(jenkins-hbase4.apache.org,42909,1676793648543)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,353 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 08:00:51,353 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 08:00:51,353 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,353 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-19 08:00:51,353 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42909,1676793648543' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-19 08:00:51,355 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,355 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:51,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:51,355 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,355 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:51,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:51,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:51,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42909,1676793648543' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-19 08:00:51,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a07632f[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:51,357 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-19 08:00:51,357 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,358 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,358 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,359 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-19 08:00:51,359 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-19 08:00:51,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,359 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,45395,1676793648562' in zk 2023-02-19 08:00:51,359 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-19 08:00:51,359 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-19 08:00:51,359 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,359 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:51,359 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,42909,1676793648543' in zk 2023-02-19 08:00:51,360 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-19 08:00:51,360 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:51,360 DEBUG [member: 'jenkins-hbase4.apache.org,45395,1676793648562' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-19 08:00:51,361 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-19 08:00:51,361 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:51,361 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,361 DEBUG [member: 'jenkins-hbase4.apache.org,42909,1676793648543' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-19 08:00:51,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:51,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,42909,1676793648543': 2023-02-19 08:00:51,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42909,1676793648543' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-19 08:00:51,364 INFO [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-19 08:00:51,364 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:51,364 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:51,364 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,364 INFO [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 08:00:51,365 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,365 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,366 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:51,366 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:51,366 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:51,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:51,366 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:51,366 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,368 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:51,369 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:51,371 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:51,371 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,371 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,371 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:51,371 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:51,371 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:51,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:51,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks because node does not exist (not an error) 2023-02-19 08:00:51,371 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:51,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-19 08:00:51,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 08:00:51,371 DEBUG [(jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:51,371 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:51,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:51,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:51,371 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:51,372 DEBUG [Listener at localhost/41625] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:51,372 DEBUG [Listener at localhost/41625] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 08:00:51,372 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,372 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,372 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,372 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:51,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:51,472 DEBUG [Listener at localhost/41625] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 08:00:51,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 08:00:51,477 INFO [Listener at localhost/41625] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676793650858 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:51,477 DEBUG [Listener at localhost/41625] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38205/user/jenkins/test-data/45f74e64-5adb-e00c-29ba-447066fc2d1b/foo/d1cfc465-3fa5-4c44-9311-0d653940a631/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,478 INFO [Listener at localhost/41625] snapshot.RestoreSnapshotHelper(239): region to add: 4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:51,478 INFO [Listener at localhost/41625] snapshot.RestoreSnapshotHelper(585): clone region=4dc10f3bf98c12a20160d15c35981d18 as 4dc10f3bf98c12a20160d15c35981d18 in snapshot foo 2023-02-19 08:00:51,479 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4dc10f3bf98c12a20160d15c35981d18, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38205/user/jenkins/test-data/45f74e64-5adb-e00c-29ba-447066fc2d1b/foo/d1cfc465-3fa5-4c44-9311-0d653940a631 2023-02-19 08:00:51,485 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:51,485 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0ca9f1270f5d464297b40daf9aa4a434 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,487 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1f490126f8ab42e588f29ca789f6e5f5 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,489 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4dc10f3bf98c12a20160d15c35981d18, disabling compactions & flushes 2023-02-19 08:00:51,489 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,489 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,489 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. after waiting 0 ms 2023-02-19 08:00:51,489 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,489 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,489 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4dc10f3bf98c12a20160d15c35981d18: 2023-02-19 08:00:51,491 INFO [Listener at localhost/41625] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676793650858 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:51,491 DEBUG [Listener at localhost/41625] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38205/user/jenkins/test-data/45f74e64-5adb-e00c-29ba-447066fc2d1b/foo/d1cfc465-3fa5-4c44-9311-0d653940a631 2023-02-19 08:00:51,491 DEBUG [Listener at localhost/41625] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38205/user/jenkins/test-data/45f74e64-5adb-e00c-29ba-447066fc2d1b/foo/d1cfc465-3fa5-4c44-9311-0d653940a631 2023-02-19 08:00:51,492 DEBUG [Listener at localhost/41625] util.CommonFSUtils(699): |-data/ 2023-02-19 08:00:51,492 DEBUG [Listener at localhost/41625] util.CommonFSUtils(699): |----default/ 2023-02-19 08:00:51,493 DEBUG [Listener at localhost/41625] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-19 08:00:51,493 DEBUG [Listener at localhost/41625] util.CommonFSUtils(699): |----------4dc10f3bf98c12a20160d15c35981d18/ 2023-02-19 08:00:51,493 DEBUG [Listener at localhost/41625] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:51,493 DEBUG [Listener at localhost/41625] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:51,494 DEBUG [Listener at localhost/41625] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=4dc10f3bf98c12a20160d15c35981d18-0ca9f1270f5d464297b40daf9aa4a434 2023-02-19 08:00:51,494 DEBUG [Listener at localhost/41625] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:51,494 DEBUG [Listener at localhost/41625] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=4dc10f3bf98c12a20160d15c35981d18-1f490126f8ab42e588f29ca789f6e5f5 hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/0ca9f1270f5d464297b40daf9aa4a434 hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/7abb6ad03b6e473481cf8ca503c842a2 hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/1f490126f8ab42e588f29ca789f6e5f5 hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/7011ccbb876e4c6bbb3263945eaba01f 2023-02-19 08:00:51,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-19 08:00:51,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-19 08:00:51,503 INFO [Listener at localhost/41625] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:51,506 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793651506"}]},"ts":"1676793651506"} 2023-02-19 08:00:51,507 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-19 08:00:51,509 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-19 08:00:51,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=4dc10f3bf98c12a20160d15c35981d18, UNASSIGN}] 2023-02-19 08:00:51,511 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=4dc10f3bf98c12a20160d15c35981d18, UNASSIGN 2023-02-19 08:00:51,511 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4dc10f3bf98c12a20160d15c35981d18, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,512 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676793651511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793651511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793651511"}]},"ts":"1676793651511"} 2023-02-19 08:00:51,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 4dc10f3bf98c12a20160d15c35981d18, server=jenkins-hbase4.apache.org,42909,1676793648543}] 2023-02-19 08:00:51,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:51,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:51,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4dc10f3bf98c12a20160d15c35981d18, disabling compactions & flushes 2023-02-19 08:00:51,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. after waiting 0 ms 2023-02-19 08:00:51,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:51,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18. 2023-02-19 08:00:51,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4dc10f3bf98c12a20160d15c35981d18: 2023-02-19 08:00:51,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:51,670 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4dc10f3bf98c12a20160d15c35981d18, regionState=CLOSED 2023-02-19 08:00:51,670 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676793651670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793651670"}]},"ts":"1676793651670"} 2023-02-19 08:00:51,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 08:00:51,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 4dc10f3bf98c12a20160d15c35981d18, server=jenkins-hbase4.apache.org,42909,1676793648543 in 158 msec 2023-02-19 08:00:51,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 08:00:51,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=4dc10f3bf98c12a20160d15c35981d18, UNASSIGN in 163 msec 2023-02-19 08:00:51,674 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793651674"}]},"ts":"1676793651674"} 2023-02-19 08:00:51,675 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-19 08:00:51,676 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-19 08:00:51,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 174 msec 2023-02-19 08:00:51,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:51,809 INFO [Listener at localhost/41625] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-19 08:00:51,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,813 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,814 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 08:00:51,817 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:51,819 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1, FileablePath, hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2, FileablePath, hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/recovered.edits] 2023-02-19 08:00:51,822 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/0ca9f1270f5d464297b40daf9aa4a434 to hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/0ca9f1270f5d464297b40daf9aa4a434 2023-02-19 08:00:51,823 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/7abb6ad03b6e473481cf8ca503c842a2 to hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f1/7abb6ad03b6e473481cf8ca503c842a2 2023-02-19 08:00:51,825 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/1f490126f8ab42e588f29ca789f6e5f5 to hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/1f490126f8ab42e588f29ca789f6e5f5 2023-02-19 08:00:51,826 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/7011ccbb876e4c6bbb3263945eaba01f to hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/f2/7011ccbb876e4c6bbb3263945eaba01f 2023-02-19 08:00:51,828 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/recovered.edits/12.seqid to hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18/recovered.edits/12.seqid 2023-02-19 08:00:51,829 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/4dc10f3bf98c12a20160d15c35981d18 2023-02-19 08:00:51,829 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-19 08:00:51,830 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,832 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-19 08:00:51,833 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-19 08:00:51,837 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,837 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-19 08:00:51,837 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793651837"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:51,839 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 08:00:51,839 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4dc10f3bf98c12a20160d15c35981d18, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676793650122.4dc10f3bf98c12a20160d15c35981d18.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 08:00:51,839 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-19 08:00:51,839 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676793651839"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:51,840 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-19 08:00:51,842 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-19 08:00:51,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 32 msec 2023-02-19 08:00:51,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35723] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 08:00:51,916 INFO [Listener at localhost/41625] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-19 08:00:51,916 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 08:00:51,916 INFO [Listener at localhost/41625] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 08:00:51,916 DEBUG [Listener at localhost/41625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24bcf5e9 to 127.0.0.1:64685 2023-02-19 08:00:51,917 DEBUG [Listener at localhost/41625] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:51,917 DEBUG [Listener at localhost/41625] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 08:00:51,917 DEBUG [Listener at localhost/41625] util.JVMClusterUtil(257): Found active master hash=594354629, stopped=false 2023-02-19 08:00:51,917 INFO [Listener at localhost/41625] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35723,1676793648505 2023-02-19 08:00:51,920 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:51,920 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:51,920 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:51,920 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:51,920 INFO [Listener at localhost/41625] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 08:00:51,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:51,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:51,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:51,922 DEBUG [Listener at localhost/41625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52372577 to 127.0.0.1:64685 2023-02-19 08:00:51,922 DEBUG [Listener at localhost/41625] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:51,923 INFO [Listener at localhost/41625] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42909,1676793648543' ***** 2023-02-19 08:00:51,923 INFO [Listener at localhost/41625] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:51,923 INFO [Listener at localhost/41625] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45395,1676793648562' ***** 2023-02-19 08:00:51,923 INFO [Listener at localhost/41625] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:51,923 INFO [RS:0;jenkins-hbase4:42909] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:51,923 INFO [RS:0;jenkins-hbase4:42909] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:51,923 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:51,923 INFO [RS:1;jenkins-hbase4:45395] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:51,923 INFO [RS:0;jenkins-hbase4:42909] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:51,923 INFO [RS:1;jenkins-hbase4:45395] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:51,923 INFO [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:51,923 INFO [RS:1;jenkins-hbase4:45395] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:51,923 DEBUG [RS:0;jenkins-hbase4:42909] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ed701f5 to 127.0.0.1:64685 2023-02-19 08:00:51,923 INFO [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(3304): Received CLOSE for 93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:51,924 DEBUG [RS:0;jenkins-hbase4:42909] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:51,924 INFO [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42909,1676793648543; all regions closed. 2023-02-19 08:00:51,924 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:51,929 INFO [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:51,929 DEBUG [RS:1;jenkins-hbase4:45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0252da6f to 127.0.0.1:64685 2023-02-19 08:00:51,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 93fceff61dd40e8332efdd390346cbe2, disabling compactions & flushes 2023-02-19 08:00:51,929 DEBUG [RS:1;jenkins-hbase4:45395] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:51,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:51,929 INFO [RS:1;jenkins-hbase4:45395] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:51,929 INFO [RS:1;jenkins-hbase4:45395] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:51,929 INFO [RS:1;jenkins-hbase4:45395] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:51,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:51,929 INFO [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 08:00:51,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. after waiting 1 ms 2023-02-19 08:00:51,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:51,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 93fceff61dd40e8332efdd390346cbe2 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 08:00:51,930 INFO [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-19 08:00:51,930 DEBUG [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 93fceff61dd40e8332efdd390346cbe2=hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2.} 2023-02-19 08:00:51,930 DEBUG [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1505): Waiting on 1588230740, 93fceff61dd40e8332efdd390346cbe2 2023-02-19 08:00:51,930 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:51,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:51,930 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:51,930 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:51,930 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:51,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-19 08:00:51,933 DEBUG [RS:0;jenkins-hbase4:42909] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/oldWALs 2023-02-19 08:00:51,934 INFO [RS:0;jenkins-hbase4:42909] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42909%2C1676793648543:(num 1676793649881) 2023-02-19 08:00:51,934 DEBUG [RS:0;jenkins-hbase4:42909] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:51,934 INFO [RS:0;jenkins-hbase4:42909] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:51,934 INFO [RS:0;jenkins-hbase4:42909] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:51,934 INFO [RS:0;jenkins-hbase4:42909] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:51,934 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 08:00:51,934 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:51,934 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 08:00:51,934 INFO [RS:0;jenkins-hbase4:42909] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:51,934 INFO [RS:0;jenkins-hbase4:42909] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:51,936 INFO [RS:0;jenkins-hbase4:42909] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42909 2023-02-19 08:00:51,958 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:51,959 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:51,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/.tmp/info/a2ba175c97a5401db1fe826c5c367dfc 2023-02-19 08:00:51,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2/.tmp/info/f226e1349c1546998f032c9f9a4f8b82 2023-02-19 08:00:51,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2ba175c97a5401db1fe826c5c367dfc 2023-02-19 08:00:51,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2/.tmp/info/f226e1349c1546998f032c9f9a4f8b82 as hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2/info/f226e1349c1546998f032c9f9a4f8b82 2023-02-19 08:00:51,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2/info/f226e1349c1546998f032c9f9a4f8b82, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 08:00:51,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 93fceff61dd40e8332efdd390346cbe2 in 43ms, sequenceid=6, compaction requested=false 2023-02-19 08:00:51,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/.tmp/rep_barrier/4cfc77585c374e03be16fe232c4eaac3 2023-02-19 08:00:51,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/namespace/93fceff61dd40e8332efdd390346cbe2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 08:00:51,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:51,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 93fceff61dd40e8332efdd390346cbe2: 2023-02-19 08:00:51,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676793649585.93fceff61dd40e8332efdd390346cbe2. 2023-02-19 08:00:51,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4cfc77585c374e03be16fe232c4eaac3 2023-02-19 08:00:51,985 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/.tmp/table/3900b49c9218401fb0c4c2e98fad94bc 2023-02-19 08:00:51,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3900b49c9218401fb0c4c2e98fad94bc 2023-02-19 08:00:51,989 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/.tmp/info/a2ba175c97a5401db1fe826c5c367dfc as hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/info/a2ba175c97a5401db1fe826c5c367dfc 2023-02-19 08:00:51,992 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2ba175c97a5401db1fe826c5c367dfc 2023-02-19 08:00:51,992 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/info/a2ba175c97a5401db1fe826c5c367dfc, entries=12, sequenceid=21, filesize=6.3 K 2023-02-19 08:00:51,993 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/.tmp/rep_barrier/4cfc77585c374e03be16fe232c4eaac3 as hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/rep_barrier/4cfc77585c374e03be16fe232c4eaac3 2023-02-19 08:00:51,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4cfc77585c374e03be16fe232c4eaac3 2023-02-19 08:00:51,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/rep_barrier/4cfc77585c374e03be16fe232c4eaac3, entries=1, sequenceid=21, filesize=5.1 K 2023-02-19 08:00:51,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/.tmp/table/3900b49c9218401fb0c4c2e98fad94bc as hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/table/3900b49c9218401fb0c4c2e98fad94bc 2023-02-19 08:00:51,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3900b49c9218401fb0c4c2e98fad94bc 2023-02-19 08:00:51,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/table/3900b49c9218401fb0c4c2e98fad94bc, entries=4, sequenceid=21, filesize=5.1 K 2023-02-19 08:00:52,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 70ms, sequenceid=21, compaction requested=false 2023-02-19 08:00:52,003 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 08:00:52,004 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 08:00:52,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:52,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:52,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:52,027 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:52,027 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42909,1676793648543 2023-02-19 08:00:52,027 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:52,027 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:52,027 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:52,027 ERROR [Listener at localhost/41625-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3427ba8b rejected from java.util.concurrent.ThreadPoolExecutor@301828d7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:52,028 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42909,1676793648543] 2023-02-19 08:00:52,029 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42909,1676793648543; numProcessing=1 2023-02-19 08:00:52,029 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42909,1676793648543 already deleted, retry=false 2023-02-19 08:00:52,029 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42909,1676793648543 expired; onlineServers=1 2023-02-19 08:00:52,130 INFO [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45395,1676793648562; all regions closed. 2023-02-19 08:00:52,136 DEBUG [RS:1;jenkins-hbase4:45395] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/oldWALs 2023-02-19 08:00:52,137 INFO [RS:1;jenkins-hbase4:45395] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45395%2C1676793648562.meta:.meta(num 1676793649535) 2023-02-19 08:00:52,139 DEBUG [RS:1;jenkins-hbase4:45395] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/oldWALs 2023-02-19 08:00:52,140 INFO [RS:1;jenkins-hbase4:45395] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45395%2C1676793648562:(num 1676793649887) 2023-02-19 08:00:52,140 DEBUG [RS:1;jenkins-hbase4:45395] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:52,140 INFO [RS:1;jenkins-hbase4:45395] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:52,140 INFO [RS:1;jenkins-hbase4:45395] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:52,140 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:52,141 INFO [RS:1;jenkins-hbase4:45395] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45395 2023-02-19 08:00:52,142 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45395,1676793648562 2023-02-19 08:00:52,142 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:52,142 ERROR [Listener at localhost/41625-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d083e9f rejected from java.util.concurrent.ThreadPoolExecutor@7937b5e6[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:52,143 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45395,1676793648562] 2023-02-19 08:00:52,143 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45395,1676793648562; numProcessing=2 2023-02-19 08:00:52,144 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45395,1676793648562 already deleted, retry=false 2023-02-19 08:00:52,144 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45395,1676793648562 expired; onlineServers=0 2023-02-19 08:00:52,144 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35723,1676793648505' ***** 2023-02-19 08:00:52,144 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 08:00:52,145 DEBUG [M:0;jenkins-hbase4:35723] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2752a170, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:52,145 INFO [M:0;jenkins-hbase4:35723] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35723,1676793648505 2023-02-19 08:00:52,145 INFO [M:0;jenkins-hbase4:35723] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35723,1676793648505; all regions closed. 2023-02-19 08:00:52,145 DEBUG [M:0;jenkins-hbase4:35723] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:52,145 DEBUG [M:0;jenkins-hbase4:35723] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 08:00:52,145 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 08:00:52,145 DEBUG [M:0;jenkins-hbase4:35723] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 08:00:52,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793648768] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793648768,5,FailOnTimeoutGroup] 2023-02-19 08:00:52,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793648770] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793648770,5,FailOnTimeoutGroup] 2023-02-19 08:00:52,145 INFO [M:0;jenkins-hbase4:35723] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 08:00:52,146 INFO [M:0;jenkins-hbase4:35723] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 08:00:52,147 INFO [M:0;jenkins-hbase4:35723] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 08:00:52,147 DEBUG [M:0;jenkins-hbase4:35723] master.HMaster(1512): Stopping service threads 2023-02-19 08:00:52,147 INFO [M:0;jenkins-hbase4:35723] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 08:00:52,147 ERROR [M:0;jenkins-hbase4:35723] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 08:00:52,147 INFO [M:0;jenkins-hbase4:35723] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 08:00:52,147 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 08:00:52,148 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:52,148 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:52,148 DEBUG [M:0;jenkins-hbase4:35723] zookeeper.ZKUtil(398): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 08:00:52,148 WARN [M:0;jenkins-hbase4:35723] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 08:00:52,148 INFO [M:0;jenkins-hbase4:35723] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 08:00:52,148 INFO [M:0;jenkins-hbase4:35723] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 08:00:52,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:52,148 DEBUG [M:0;jenkins-hbase4:35723] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:52,149 INFO [M:0;jenkins-hbase4:35723] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:52,149 DEBUG [M:0;jenkins-hbase4:35723] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:52,149 DEBUG [M:0;jenkins-hbase4:35723] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:52,149 DEBUG [M:0;jenkins-hbase4:35723] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:52,149 INFO [M:0;jenkins-hbase4:35723] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.66 KB heapSize=67.62 KB 2023-02-19 08:00:52,158 INFO [M:0;jenkins-hbase4:35723] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.66 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/208cfdf4a1164e10a5b23b7773765f01 2023-02-19 08:00:52,161 DEBUG [M:0;jenkins-hbase4:35723] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/208cfdf4a1164e10a5b23b7773765f01 as hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/208cfdf4a1164e10a5b23b7773765f01 2023-02-19 08:00:52,165 INFO [M:0;jenkins-hbase4:35723] regionserver.HStore(1080): Added hdfs://localhost:38205/user/jenkins/test-data/6e70d452-66e0-7b3f-7b9d-c487e2c4378a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/208cfdf4a1164e10a5b23b7773765f01, entries=17, sequenceid=132, filesize=8.7 K 2023-02-19 08:00:52,165 INFO [M:0;jenkins-hbase4:35723] regionserver.HRegion(2947): Finished flush of dataSize ~56.66 KB/58020, heapSize ~67.60 KB/69224, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-19 08:00:52,166 INFO [M:0;jenkins-hbase4:35723] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:52,166 DEBUG [M:0;jenkins-hbase4:35723] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:52,168 INFO [M:0;jenkins-hbase4:35723] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 08:00:52,168 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:52,168 INFO [M:0;jenkins-hbase4:35723] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35723 2023-02-19 08:00:52,170 DEBUG [M:0;jenkins-hbase4:35723] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35723,1676793648505 already deleted, retry=false 2023-02-19 08:00:52,222 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:52,222 INFO [RS:0;jenkins-hbase4:42909] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42909,1676793648543; zookeeper connection closed. 2023-02-19 08:00:52,222 ERROR [Listener at localhost/41625-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4ddf28cf rejected from java.util.concurrent.ThreadPoolExecutor@301828d7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:52,222 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:42909-0x1006b987f2c0001, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:52,222 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@461e389a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@461e389a 2023-02-19 08:00:52,222 ERROR [Listener at localhost/41625-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@358ae6ce rejected from java.util.concurrent.ThreadPoolExecutor@301828d7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:52,422 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:52,422 INFO [M:0;jenkins-hbase4:35723] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35723,1676793648505; zookeeper connection closed. 2023-02-19 08:00:52,423 ERROR [Listener at localhost/41625-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e75c434 rejected from java.util.concurrent.ThreadPoolExecutor@4a4a5922[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 53] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:52,423 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): master:35723-0x1006b987f2c0000, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:52,424 ERROR [Listener at localhost/41625-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5eb95d16 rejected from java.util.concurrent.ThreadPoolExecutor@4a4a5922[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 53] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:52,523 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:52,523 INFO [RS:1;jenkins-hbase4:45395] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45395,1676793648562; zookeeper connection closed. 2023-02-19 08:00:52,523 ERROR [Listener at localhost/41625-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@318366da rejected from java.util.concurrent.ThreadPoolExecutor@7937b5e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:52,523 DEBUG [Listener at localhost/41625-EventThread] zookeeper.ZKWatcher(600): regionserver:45395-0x1006b987f2c0002, quorum=127.0.0.1:64685, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:52,523 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@50181c18] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@50181c18 2023-02-19 08:00:52,523 ERROR [Listener at localhost/41625-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@491f4678 rejected from java.util.concurrent.ThreadPoolExecutor@7937b5e6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:52,523 INFO [Listener at localhost/41625] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 08:00:52,524 WARN [Listener at localhost/41625] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:52,534 INFO [Listener at localhost/41625] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:52,539 WARN [BP-950575749-172.31.14.131-1676793647881 heartbeating to localhost/127.0.0.1:38205] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:52,539 WARN [BP-950575749-172.31.14.131-1676793647881 heartbeating to localhost/127.0.0.1:38205] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-950575749-172.31.14.131-1676793647881 (Datanode Uuid 0ecbb181-ee9d-47f2-9208-be669eb0cedd) service to localhost/127.0.0.1:38205 2023-02-19 08:00:52,540 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/cluster_4d70f698-dcec-8638-417b-52ee29f45a44/dfs/data/data3/current/BP-950575749-172.31.14.131-1676793647881] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:52,540 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/cluster_4d70f698-dcec-8638-417b-52ee29f45a44/dfs/data/data4/current/BP-950575749-172.31.14.131-1676793647881] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:52,541 WARN [Listener at localhost/41625] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:52,552 INFO [Listener at localhost/41625] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:52,657 WARN [BP-950575749-172.31.14.131-1676793647881 heartbeating to localhost/127.0.0.1:38205] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:52,657 WARN [BP-950575749-172.31.14.131-1676793647881 heartbeating to localhost/127.0.0.1:38205] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-950575749-172.31.14.131-1676793647881 (Datanode Uuid 1a2766f4-b8ed-4574-bbc1-7b0d5ab925a7) service to localhost/127.0.0.1:38205 2023-02-19 08:00:52,657 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/cluster_4d70f698-dcec-8638-417b-52ee29f45a44/dfs/data/data1/current/BP-950575749-172.31.14.131-1676793647881] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:52,658 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/cluster_4d70f698-dcec-8638-417b-52ee29f45a44/dfs/data/data2/current/BP-950575749-172.31.14.131-1676793647881] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:52,667 INFO [Listener at localhost/41625] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:52,780 INFO [Listener at localhost/41625] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 08:00:52,794 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 08:00:52,807 INFO [Listener at localhost/41625] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=274 (was 255) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35723,1676793648505)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:38205 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:38205 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:38205 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:38205 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38205 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41625 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:38205 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:38205 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=576 (was 655), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=378 (was 359) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8986 (was 9132) 2023-02-19 08:00:52,817 INFO [Listener at localhost/41625] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=274, OpenFileDescriptor=576, MaxFileDescriptor=60000, SystemLoadAverage=378, ProcessCount=170, AvailableMemoryMB=8985 2023-02-19 08:00:52,827 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/hadoop.log.dir so I do NOT create it in target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453 2023-02-19 08:00:52,827 WARN [Listener at localhost/41625] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/hadoop.log.dir Erasing configuration value by system value. 2023-02-19 08:00:52,827 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/hadoop.tmp.dir so I do NOT create it in target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453 2023-02-19 08:00:52,827 WARN [Listener at localhost/41625] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee6d2258-afd6-8a6b-3a06-e0a45b22ea1c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-19 08:00:52,827 DEBUG [Listener at localhost/41625] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453 2023-02-19 08:00:52,828 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-19 08:00:52,828 INFO [Listener at localhost/41625] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/cluster_f34c09f6-c094-f5d6-6955-7cea7e88914d, deleteOnExit=true 2023-02-19 08:00:52,828 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-19 08:00:52,828 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/test.cache.data in system properties and HBase conf 2023-02-19 08:00:52,828 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/hadoop.tmp.dir in system properties and HBase conf 2023-02-19 08:00:52,828 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/hadoop.log.dir in system properties and HBase conf 2023-02-19 08:00:52,828 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-19 08:00:52,828 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-19 08:00:52,828 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-19 08:00:52,828 DEBUG [Listener at localhost/41625] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-19 08:00:52,829 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:52,829 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-19 08:00:52,829 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-19 08:00:52,829 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:52,829 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-19 08:00:52,829 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-19 08:00:52,829 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-19 08:00:52,829 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:52,829 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-19 08:00:52,829 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/nfs.dump.dir in system properties and HBase conf 2023-02-19 08:00:52,830 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/java.io.tmpdir in system properties and HBase conf 2023-02-19 08:00:52,830 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-19 08:00:52,830 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-19 08:00:52,830 INFO [Listener at localhost/41625] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-19 08:00:52,834 WARN [Listener at localhost/41625] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:52,834 WARN [Listener at localhost/41625] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:52,877 WARN [Listener at localhost/41625] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:52,879 INFO [Listener at localhost/41625] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:52,897 INFO [Listener at localhost/41625] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/java.io.tmpdir/Jetty_localhost_41637_hdfs____4jfxgn/webapp 2023-02-19 08:00:52,993 INFO [Listener at localhost/41625] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41637 2023-02-19 08:00:52,998 WARN [Listener at localhost/41625] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-19 08:00:52,998 WARN [Listener at localhost/41625] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-19 08:00:53,035 WARN [Listener at localhost/46177] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:53,046 WARN [Listener at localhost/46177] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:53,048 WARN [Listener at localhost/46177] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:53,049 INFO [Listener at localhost/46177] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:53,053 INFO [Listener at localhost/46177] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/java.io.tmpdir/Jetty_localhost_45155_datanode____thvmf/webapp 2023-02-19 08:00:53,160 INFO [Listener at localhost/46177] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45155 2023-02-19 08:00:53,168 WARN [Listener at localhost/34953] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:53,185 WARN [Listener at localhost/34953] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-19 08:00:53,188 WARN [Listener at localhost/34953] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-19 08:00:53,189 INFO [Listener at localhost/34953] log.Slf4jLog(67): jetty-6.1.26 2023-02-19 08:00:53,194 INFO [Listener at localhost/34953] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/java.io.tmpdir/Jetty_localhost_44889_datanode____.2rlg4g/webapp 2023-02-19 08:00:53,264 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x940b2a32fcbc3335: Processing first storage report for DS-cce4edab-f6a8-4b9e-9743-9bcda05219b8 from datanode dac78fcc-409b-4d07-ba49-52f0f58e1139 2023-02-19 08:00:53,264 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x940b2a32fcbc3335: from storage DS-cce4edab-f6a8-4b9e-9743-9bcda05219b8 node DatanodeRegistration(127.0.0.1:45051, datanodeUuid=dac78fcc-409b-4d07-ba49-52f0f58e1139, infoPort=34759, infoSecurePort=0, ipcPort=34953, storageInfo=lv=-57;cid=testClusterID;nsid=441412286;c=1676793652836), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:53,265 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x940b2a32fcbc3335: Processing first storage report for DS-8449a944-4f2a-4451-bbba-199d3851d0fb from datanode dac78fcc-409b-4d07-ba49-52f0f58e1139 2023-02-19 08:00:53,265 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x940b2a32fcbc3335: from storage DS-8449a944-4f2a-4451-bbba-199d3851d0fb node DatanodeRegistration(127.0.0.1:45051, datanodeUuid=dac78fcc-409b-4d07-ba49-52f0f58e1139, infoPort=34759, infoSecurePort=0, ipcPort=34953, storageInfo=lv=-57;cid=testClusterID;nsid=441412286;c=1676793652836), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:53,317 INFO [Listener at localhost/34953] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44889 2023-02-19 08:00:53,326 WARN [Listener at localhost/43261] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-19 08:00:53,423 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5fef0be186b25db5: Processing first storage report for DS-618f88bf-a4f3-4e06-9d18-bbc2b982e15e from datanode 15964414-18f1-4296-a396-c45cc5bb61d1 2023-02-19 08:00:53,423 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5fef0be186b25db5: from storage DS-618f88bf-a4f3-4e06-9d18-bbc2b982e15e node DatanodeRegistration(127.0.0.1:40567, datanodeUuid=15964414-18f1-4296-a396-c45cc5bb61d1, infoPort=32945, infoSecurePort=0, ipcPort=43261, storageInfo=lv=-57;cid=testClusterID;nsid=441412286;c=1676793652836), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:53,423 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5fef0be186b25db5: Processing first storage report for DS-9fd70993-8c77-48f7-b0f7-9a44376fcd98 from datanode 15964414-18f1-4296-a396-c45cc5bb61d1 2023-02-19 08:00:53,423 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5fef0be186b25db5: from storage DS-9fd70993-8c77-48f7-b0f7-9a44376fcd98 node DatanodeRegistration(127.0.0.1:40567, datanodeUuid=15964414-18f1-4296-a396-c45cc5bb61d1, infoPort=32945, infoSecurePort=0, ipcPort=43261, storageInfo=lv=-57;cid=testClusterID;nsid=441412286;c=1676793652836), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-19 08:00:53,432 DEBUG [Listener at localhost/43261] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453 2023-02-19 08:00:53,434 INFO [Listener at localhost/43261] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/cluster_f34c09f6-c094-f5d6-6955-7cea7e88914d/zookeeper_0, clientPort=58569, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/cluster_f34c09f6-c094-f5d6-6955-7cea7e88914d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/cluster_f34c09f6-c094-f5d6-6955-7cea7e88914d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-19 08:00:53,435 INFO [Listener at localhost/43261] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58569 2023-02-19 08:00:53,435 INFO [Listener at localhost/43261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,436 INFO [Listener at localhost/43261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,465 INFO [Listener at localhost/43261] util.FSUtils(479): Created version file at hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b with version=8 2023-02-19 08:00:53,465 INFO [Listener at localhost/43261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,466 INFO [Listener at localhost/43261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,467 INFO [Listener at localhost/43261] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46177/user/jenkins/test-data/ffc4c943-da00-6d11-2403-df415e046ae9/hbase-staging 2023-02-19 08:00:53,469 INFO [Listener at localhost/43261] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:53,469 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:53,469 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:53,469 INFO [Listener at localhost/43261] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:53,469 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:53,469 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:53,469 INFO [Listener at localhost/43261] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:53,470 INFO [Listener at localhost/43261] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41907 2023-02-19 08:00:53,470 INFO [Listener at localhost/43261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,471 INFO [Listener at localhost/43261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,472 INFO [Listener at localhost/43261] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41907 connecting to ZooKeeper ensemble=127.0.0.1:58569 2023-02-19 08:00:53,481 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:419070x0, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:53,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41907-0x1006b98927e0000 connected 2023-02-19 08:00:53,500 DEBUG [Listener at localhost/43261] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:53,500 DEBUG [Listener at localhost/43261] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:53,501 DEBUG [Listener at localhost/43261] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:53,503 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41907 2023-02-19 08:00:53,503 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41907 2023-02-19 08:00:53,503 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41907 2023-02-19 08:00:53,504 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41907 2023-02-19 08:00:53,504 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41907 2023-02-19 08:00:53,504 INFO [Listener at localhost/43261] master.HMaster(444): hbase.rootdir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b, hbase.cluster.distributed=false 2023-02-19 08:00:53,516 INFO [Listener at localhost/43261] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:53,516 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:53,516 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:53,516 INFO [Listener at localhost/43261] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:53,516 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:53,516 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:53,516 INFO [Listener at localhost/43261] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:53,517 INFO [Listener at localhost/43261] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33899 2023-02-19 08:00:53,517 INFO [Listener at localhost/43261] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:53,518 DEBUG [Listener at localhost/43261] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:53,518 INFO [Listener at localhost/43261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,519 INFO [Listener at localhost/43261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,520 INFO [Listener at localhost/43261] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33899 connecting to ZooKeeper ensemble=127.0.0.1:58569 2023-02-19 08:00:53,522 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:338990x0, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:53,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33899-0x1006b98927e0001 connected 2023-02-19 08:00:53,525 DEBUG [Listener at localhost/43261] zookeeper.ZKUtil(164): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:53,526 DEBUG [Listener at localhost/43261] zookeeper.ZKUtil(164): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:53,526 DEBUG [Listener at localhost/43261] zookeeper.ZKUtil(164): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:53,526 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33899 2023-02-19 08:00:53,527 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33899 2023-02-19 08:00:53,527 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33899 2023-02-19 08:00:53,527 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33899 2023-02-19 08:00:53,527 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33899 2023-02-19 08:00:53,538 INFO [Listener at localhost/43261] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-19 08:00:53,538 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:53,538 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:53,538 INFO [Listener at localhost/43261] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-19 08:00:53,538 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-19 08:00:53,538 INFO [Listener at localhost/43261] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-19 08:00:53,538 INFO [Listener at localhost/43261] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-19 08:00:53,539 INFO [Listener at localhost/43261] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46731 2023-02-19 08:00:53,539 INFO [Listener at localhost/43261] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-19 08:00:53,539 DEBUG [Listener at localhost/43261] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:53,540 INFO [Listener at localhost/43261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,540 INFO [Listener at localhost/43261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,541 INFO [Listener at localhost/43261] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46731 connecting to ZooKeeper ensemble=127.0.0.1:58569 2023-02-19 08:00:53,543 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:467310x0, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-19 08:00:53,543 DEBUG [Listener at localhost/43261] zookeeper.ZKUtil(164): regionserver:467310x0, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:53,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46731-0x1006b98927e0002 connected 2023-02-19 08:00:53,595 DEBUG [Listener at localhost/43261] zookeeper.ZKUtil(164): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:53,597 DEBUG [Listener at localhost/43261] zookeeper.ZKUtil(164): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-19 08:00:53,601 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46731 2023-02-19 08:00:53,601 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46731 2023-02-19 08:00:53,601 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46731 2023-02-19 08:00:53,602 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46731 2023-02-19 08:00:53,602 DEBUG [Listener at localhost/43261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46731 2023-02-19 08:00:53,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41907,1676793653468 2023-02-19 08:00:53,606 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:53,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41907,1676793653468 2023-02-19 08:00:53,608 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:53,608 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:53,608 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:53,608 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:53,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:53,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41907,1676793653468 from backup master directory 2023-02-19 08:00:53,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-19 08:00:53,613 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41907,1676793653468 2023-02-19 08:00:53,613 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-19 08:00:53,613 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:53,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41907,1676793653468 2023-02-19 08:00:53,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/hbase.id with ID: ddb705dc-d34f-46c5-8793-b82e93657319 2023-02-19 08:00:53,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-19 08:00:53,633 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:53,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7609e18b to 127.0.0.1:58569 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:53,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18e0ad3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:53,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:53,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-19 08:00:53,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:53,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/data/master/store-tmp 2023-02-19 08:00:53,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:53,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:53,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:53,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:53,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:53,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:53,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:53,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:53,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/WALs/jenkins-hbase4.apache.org,41907,1676793653468 2023-02-19 08:00:53,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41907%2C1676793653468, suffix=, logDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/WALs/jenkins-hbase4.apache.org,41907,1676793653468, archiveDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/oldWALs, maxLogs=10 2023-02-19 08:00:53,683 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45051,DS-cce4edab-f6a8-4b9e-9743-9bcda05219b8,DISK] 2023-02-19 08:00:53,684 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40567,DS-618f88bf-a4f3-4e06-9d18-bbc2b982e15e,DISK] 2023-02-19 08:00:53,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/WALs/jenkins-hbase4.apache.org,41907,1676793653468/jenkins-hbase4.apache.org%2C41907%2C1676793653468.1676793653665 2023-02-19 08:00:53,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45051,DS-cce4edab-f6a8-4b9e-9743-9bcda05219b8,DISK], DatanodeInfoWithStorage[127.0.0.1:40567,DS-618f88bf-a4f3-4e06-9d18-bbc2b982e15e,DISK]] 2023-02-19 08:00:53,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:53,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:53,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:53,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:53,692 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:53,694 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-19 08:00:53,694 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-19 08:00:53,695 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:53,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:53,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:53,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-19 08:00:53,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:53,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59958059, jitterRate=-0.10655529797077179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:53,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:53,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-19 08:00:53,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-19 08:00:53,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-19 08:00:53,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-19 08:00:53,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-19 08:00:53,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-19 08:00:53,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-19 08:00:53,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-19 08:00:53,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-19 08:00:53,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-19 08:00:53,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-19 08:00:53,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-19 08:00:53,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-19 08:00:53,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-19 08:00:53,720 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:53,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-19 08:00:53,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-19 08:00:53,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-19 08:00:53,723 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:53,723 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:53,723 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:53,723 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:53,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41907,1676793653468, sessionid=0x1006b98927e0000, setting cluster-up flag (Was=false) 2023-02-19 08:00:53,733 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:53,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-19 08:00:53,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41907,1676793653468 2023-02-19 08:00:53,741 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:53,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-19 08:00:53,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41907,1676793653468 2023-02-19 08:00:53,752 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.hbase-snapshot/.tmp 2023-02-19 08:00:53,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:53,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:53,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:53,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:53,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-19 08:00:53,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-19 08:00:53,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:53,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676793683755 2023-02-19 08:00:53,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-19 08:00:53,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-19 08:00:53,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-19 08:00:53,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-19 08:00:53,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-19 08:00:53,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-19 08:00:53,756 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:53,756 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-19 08:00:53,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-19 08:00:53,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-19 08:00:53,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-19 08:00:53,758 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:53,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-19 08:00:53,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-19 08:00:53,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793653758,5,FailOnTimeoutGroup] 2023-02-19 08:00:53,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793653758,5,FailOnTimeoutGroup] 2023-02-19 08:00:53,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-19 08:00:53,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,766 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:53,766 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:53,767 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b 2023-02-19 08:00:53,775 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:53,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:53,776 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/info 2023-02-19 08:00:53,777 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:53,777 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:53,777 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:53,778 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:53,778 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:53,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:53,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:53,779 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/table 2023-02-19 08:00:53,779 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:53,780 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:53,780 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740 2023-02-19 08:00:53,780 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740 2023-02-19 08:00:53,782 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:53,782 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:53,783 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:53,783 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69715804, jitterRate=0.03884643316268921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:53,784 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:53,784 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:53,784 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:53,784 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:53,784 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:53,784 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:53,784 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:53,784 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:53,785 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-19 08:00:53,785 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-19 08:00:53,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-19 08:00:53,786 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-19 08:00:53,787 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-19 08:00:53,804 INFO [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(952): ClusterId : ddb705dc-d34f-46c5-8793-b82e93657319 2023-02-19 08:00:53,804 INFO [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(952): ClusterId : ddb705dc-d34f-46c5-8793-b82e93657319 2023-02-19 08:00:53,804 DEBUG [RS:0;jenkins-hbase4:33899] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:53,804 DEBUG [RS:1;jenkins-hbase4:46731] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-19 08:00:53,806 DEBUG [RS:0;jenkins-hbase4:33899] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:53,806 DEBUG [RS:0;jenkins-hbase4:33899] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:53,806 DEBUG [RS:1;jenkins-hbase4:46731] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-19 08:00:53,806 DEBUG [RS:1;jenkins-hbase4:46731] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-19 08:00:53,807 DEBUG [RS:0;jenkins-hbase4:33899] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:53,808 DEBUG [RS:0;jenkins-hbase4:33899] zookeeper.ReadOnlyZKClient(139): Connect 0x1ef16fc3 to 127.0.0.1:58569 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:53,808 DEBUG [RS:1;jenkins-hbase4:46731] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-19 08:00:53,809 DEBUG [RS:1;jenkins-hbase4:46731] zookeeper.ReadOnlyZKClient(139): Connect 0x106db4a3 to 127.0.0.1:58569 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:53,813 DEBUG [RS:0;jenkins-hbase4:33899] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1036826d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:53,813 DEBUG [RS:0;jenkins-hbase4:33899] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@140904b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:53,813 DEBUG [RS:1;jenkins-hbase4:46731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eaa48de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:53,813 DEBUG [RS:1;jenkins-hbase4:46731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a95dfd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:53,822 DEBUG [RS:1;jenkins-hbase4:46731] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46731 2023-02-19 08:00:53,822 DEBUG [RS:0;jenkins-hbase4:33899] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33899 2023-02-19 08:00:53,822 INFO [RS:1;jenkins-hbase4:46731] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:53,822 INFO [RS:0;jenkins-hbase4:33899] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-19 08:00:53,822 INFO [RS:0;jenkins-hbase4:33899] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:53,822 INFO [RS:1;jenkins-hbase4:46731] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-19 08:00:53,822 DEBUG [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:53,822 DEBUG [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1023): About to register with Master. 2023-02-19 08:00:53,822 INFO [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41907,1676793653468 with isa=jenkins-hbase4.apache.org/172.31.14.131:33899, startcode=1676793653516 2023-02-19 08:00:53,822 INFO [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41907,1676793653468 with isa=jenkins-hbase4.apache.org/172.31.14.131:46731, startcode=1676793653537 2023-02-19 08:00:53,822 DEBUG [RS:0;jenkins-hbase4:33899] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:53,822 DEBUG [RS:1;jenkins-hbase4:46731] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-19 08:00:53,824 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43359, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:53,824 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34577, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-19 08:00:53,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41907] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:53,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:53,826 DEBUG [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b 2023-02-19 08:00:53,826 DEBUG [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46177 2023-02-19 08:00:53,826 DEBUG [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b 2023-02-19 08:00:53,826 DEBUG [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:53,826 DEBUG [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46177 2023-02-19 08:00:53,826 DEBUG [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-19 08:00:53,830 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:53,830 DEBUG [RS:1;jenkins-hbase4:46731] zookeeper.ZKUtil(162): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:53,830 DEBUG [RS:0;jenkins-hbase4:33899] zookeeper.ZKUtil(162): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:53,831 WARN [RS:1;jenkins-hbase4:46731] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:53,831 WARN [RS:0;jenkins-hbase4:33899] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-19 08:00:53,831 INFO [RS:1;jenkins-hbase4:46731] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:53,831 INFO [RS:0;jenkins-hbase4:33899] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:53,831 DEBUG [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/WALs/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:53,831 DEBUG [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/WALs/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:53,831 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46731,1676793653537] 2023-02-19 08:00:53,831 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33899,1676793653516] 2023-02-19 08:00:53,837 DEBUG [RS:1;jenkins-hbase4:46731] zookeeper.ZKUtil(162): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:53,837 DEBUG [RS:0;jenkins-hbase4:33899] zookeeper.ZKUtil(162): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:53,838 DEBUG [RS:1;jenkins-hbase4:46731] zookeeper.ZKUtil(162): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:53,838 DEBUG [RS:0;jenkins-hbase4:33899] zookeeper.ZKUtil(162): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:53,838 DEBUG [RS:0;jenkins-hbase4:33899] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:53,838 DEBUG [RS:1;jenkins-hbase4:46731] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-19 08:00:53,839 INFO [RS:0;jenkins-hbase4:33899] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:53,839 INFO [RS:1;jenkins-hbase4:46731] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-19 08:00:53,840 INFO [RS:0;jenkins-hbase4:33899] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:53,840 INFO [RS:0;jenkins-hbase4:33899] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:53,840 INFO [RS:0;jenkins-hbase4:33899] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,840 INFO [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:53,840 INFO [RS:1;jenkins-hbase4:46731] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-19 08:00:53,842 INFO [RS:1;jenkins-hbase4:46731] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-19 08:00:53,842 INFO [RS:1;jenkins-hbase4:46731] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,843 INFO [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-19 08:00:53,844 INFO [RS:0;jenkins-hbase4:33899] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,844 DEBUG [RS:0;jenkins-hbase4:33899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,844 DEBUG [RS:0;jenkins-hbase4:33899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,844 DEBUG [RS:0;jenkins-hbase4:33899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,844 DEBUG [RS:0;jenkins-hbase4:33899] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,844 DEBUG [RS:0;jenkins-hbase4:33899] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,844 DEBUG [RS:0;jenkins-hbase4:33899] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:53,845 DEBUG [RS:0;jenkins-hbase4:33899] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,845 DEBUG [RS:0;jenkins-hbase4:33899] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,845 DEBUG [RS:0;jenkins-hbase4:33899] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,845 DEBUG [RS:0;jenkins-hbase4:33899] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,845 INFO [RS:1;jenkins-hbase4:46731] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,846 DEBUG [RS:1;jenkins-hbase4:46731] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,846 DEBUG [RS:1;jenkins-hbase4:46731] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,846 INFO [RS:0;jenkins-hbase4:33899] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,846 DEBUG [RS:1;jenkins-hbase4:46731] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,846 INFO [RS:0;jenkins-hbase4:33899] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,847 DEBUG [RS:1;jenkins-hbase4:46731] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,847 INFO [RS:0;jenkins-hbase4:33899] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,847 DEBUG [RS:1;jenkins-hbase4:46731] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,847 DEBUG [RS:1;jenkins-hbase4:46731] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-19 08:00:53,847 DEBUG [RS:1;jenkins-hbase4:46731] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,847 DEBUG [RS:1;jenkins-hbase4:46731] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,847 DEBUG [RS:1;jenkins-hbase4:46731] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,847 DEBUG [RS:1;jenkins-hbase4:46731] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-19 08:00:53,848 INFO [RS:1;jenkins-hbase4:46731] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,848 INFO [RS:1;jenkins-hbase4:46731] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,848 INFO [RS:1;jenkins-hbase4:46731] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,858 INFO [RS:0;jenkins-hbase4:33899] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:53,858 INFO [RS:0;jenkins-hbase4:33899] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33899,1676793653516-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,861 INFO [RS:1;jenkins-hbase4:46731] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-19 08:00:53,861 INFO [RS:1;jenkins-hbase4:46731] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46731,1676793653537-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:53,870 INFO [RS:0;jenkins-hbase4:33899] regionserver.Replication(203): jenkins-hbase4.apache.org,33899,1676793653516 started 2023-02-19 08:00:53,870 INFO [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33899,1676793653516, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33899, sessionid=0x1006b98927e0001 2023-02-19 08:00:53,870 INFO [RS:1;jenkins-hbase4:46731] regionserver.Replication(203): jenkins-hbase4.apache.org,46731,1676793653537 started 2023-02-19 08:00:53,870 DEBUG [RS:0;jenkins-hbase4:33899] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:53,871 DEBUG [RS:0;jenkins-hbase4:33899] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:53,870 INFO [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46731,1676793653537, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46731, sessionid=0x1006b98927e0002 2023-02-19 08:00:53,871 DEBUG [RS:0;jenkins-hbase4:33899] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33899,1676793653516' 2023-02-19 08:00:53,871 DEBUG [RS:0;jenkins-hbase4:33899] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:53,871 DEBUG [RS:1;jenkins-hbase4:46731] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-19 08:00:53,871 DEBUG [RS:1;jenkins-hbase4:46731] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:53,871 DEBUG [RS:1;jenkins-hbase4:46731] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46731,1676793653537' 2023-02-19 08:00:53,871 DEBUG [RS:1;jenkins-hbase4:46731] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:53,871 DEBUG [RS:0;jenkins-hbase4:33899] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:53,871 DEBUG [RS:1;jenkins-hbase4:46731] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:53,871 DEBUG [RS:1;jenkins-hbase4:46731] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:53,871 DEBUG [RS:0;jenkins-hbase4:33899] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-19 08:00:53,871 DEBUG [RS:1;jenkins-hbase4:46731] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:53,871 DEBUG [RS:0;jenkins-hbase4:33899] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-19 08:00:53,871 DEBUG [RS:1;jenkins-hbase4:46731] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:53,872 DEBUG [RS:1;jenkins-hbase4:46731] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46731,1676793653537' 2023-02-19 08:00:53,872 DEBUG [RS:1;jenkins-hbase4:46731] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:53,871 DEBUG [RS:0;jenkins-hbase4:33899] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:53,872 DEBUG [RS:0;jenkins-hbase4:33899] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33899,1676793653516' 2023-02-19 08:00:53,872 DEBUG [RS:0;jenkins-hbase4:33899] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:53,872 DEBUG [RS:1;jenkins-hbase4:46731] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:53,872 DEBUG [RS:0;jenkins-hbase4:33899] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:53,872 DEBUG [RS:1;jenkins-hbase4:46731] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:53,872 INFO [RS:1;jenkins-hbase4:46731] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:53,872 INFO [RS:1;jenkins-hbase4:46731] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:53,872 DEBUG [RS:0;jenkins-hbase4:33899] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-19 08:00:53,872 INFO [RS:0;jenkins-hbase4:33899] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-19 08:00:53,872 INFO [RS:0;jenkins-hbase4:33899] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-19 08:00:53,938 DEBUG [jenkins-hbase4:41907] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-19 08:00:53,938 DEBUG [jenkins-hbase4:41907] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:53,939 DEBUG [jenkins-hbase4:41907] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:53,939 DEBUG [jenkins-hbase4:41907] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:53,939 DEBUG [jenkins-hbase4:41907] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:53,939 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46731,1676793653537, state=OPENING 2023-02-19 08:00:53,942 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-19 08:00:53,943 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:53,943 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:53,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46731,1676793653537}] 2023-02-19 08:00:54,098 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:54,098 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:54,099 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47038, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:54,104 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-19 08:00:54,104 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-19 08:00:54,105 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46731%2C1676793653537.meta, suffix=.meta, logDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/WALs/jenkins-hbase4.apache.org,46731,1676793653537, archiveDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/oldWALs, maxLogs=32 2023-02-19 08:00:54,121 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45051,DS-cce4edab-f6a8-4b9e-9743-9bcda05219b8,DISK] 2023-02-19 08:00:54,121 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40567,DS-618f88bf-a4f3-4e06-9d18-bbc2b982e15e,DISK] 2023-02-19 08:00:54,123 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/WALs/jenkins-hbase4.apache.org,46731,1676793653537/jenkins-hbase4.apache.org%2C46731%2C1676793653537.meta.1676793654105.meta 2023-02-19 08:00:54,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45051,DS-cce4edab-f6a8-4b9e-9743-9bcda05219b8,DISK], DatanodeInfoWithStorage[127.0.0.1:40567,DS-618f88bf-a4f3-4e06-9d18-bbc2b982e15e,DISK]] 2023-02-19 08:00:54,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:54,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-19 08:00:54,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-19 08:00:54,123 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-19 08:00:54,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-19 08:00:54,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:54,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-19 08:00:54,124 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-19 08:00:54,125 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-19 08:00:54,125 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/info 2023-02-19 08:00:54,125 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/info 2023-02-19 08:00:54,126 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-19 08:00:54,126 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:54,126 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-19 08:00:54,127 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:54,127 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/rep_barrier 2023-02-19 08:00:54,127 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-19 08:00:54,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:54,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-19 08:00:54,128 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/table 2023-02-19 08:00:54,128 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/table 2023-02-19 08:00:54,128 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-19 08:00:54,128 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:54,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740 2023-02-19 08:00:54,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740 2023-02-19 08:00:54,131 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-19 08:00:54,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-19 08:00:54,132 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74195208, jitterRate=0.10559475421905518}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-19 08:00:54,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-19 08:00:54,133 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676793654098 2023-02-19 08:00:54,136 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-19 08:00:54,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-19 08:00:54,138 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46731,1676793653537, state=OPEN 2023-02-19 08:00:54,139 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-19 08:00:54,139 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-19 08:00:54,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-19 08:00:54,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46731,1676793653537 in 196 msec 2023-02-19 08:00:54,141 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-19 08:00:54,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 355 msec 2023-02-19 08:00:54,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 390 msec 2023-02-19 08:00:54,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676793654143, completionTime=-1 2023-02-19 08:00:54,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-19 08:00:54,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-19 08:00:54,145 DEBUG [hconnection-0x3f5032c7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:54,146 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47052, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:54,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-19 08:00:54,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676793714147 2023-02-19 08:00:54,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676793774147 2023-02-19 08:00:54,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-19 08:00:54,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41907,1676793653468-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:54,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41907,1676793653468-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:54,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41907,1676793653468-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:54,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41907, period=300000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:54,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-19 08:00:54,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-19 08:00:54,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:54,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-19 08:00:54,154 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-19 08:00:54,155 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:54,155 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:54,157 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:54,157 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6 empty. 2023-02-19 08:00:54,157 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:54,157 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-19 08:00:54,166 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:54,167 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 519140e60f29101a7add9f8dc53d77c6, NAME => 'hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp 2023-02-19 08:00:54,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:54,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 519140e60f29101a7add9f8dc53d77c6, disabling compactions & flushes 2023-02-19 08:00:54,175 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:54,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:54,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. after waiting 0 ms 2023-02-19 08:00:54,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:54,175 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:54,175 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 519140e60f29101a7add9f8dc53d77c6: 2023-02-19 08:00:54,177 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:54,178 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793654178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793654178"}]},"ts":"1676793654178"} 2023-02-19 08:00:54,179 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:54,180 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:54,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793654180"}]},"ts":"1676793654180"} 2023-02-19 08:00:54,181 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-19 08:00:54,183 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:54,183 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:54,183 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:54,183 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:54,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=519140e60f29101a7add9f8dc53d77c6, ASSIGN}] 2023-02-19 08:00:54,186 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=519140e60f29101a7add9f8dc53d77c6, ASSIGN 2023-02-19 08:00:54,186 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=519140e60f29101a7add9f8dc53d77c6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33899,1676793653516; forceNewPlan=false, retain=false 2023-02-19 08:00:54,337 INFO [jenkins-hbase4:41907] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:54,337 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=519140e60f29101a7add9f8dc53d77c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:54,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793654337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793654337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793654337"}]},"ts":"1676793654337"} 2023-02-19 08:00:54,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 519140e60f29101a7add9f8dc53d77c6, server=jenkins-hbase4.apache.org,33899,1676793653516}] 2023-02-19 08:00:54,491 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:54,491 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-19 08:00:54,493 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43938, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-19 08:00:54,497 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:54,498 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33899%2C1676793653516, suffix=, logDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/WALs/jenkins-hbase4.apache.org,33899,1676793653516, archiveDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/oldWALs, maxLogs=32 2023-02-19 08:00:54,517 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40567,DS-618f88bf-a4f3-4e06-9d18-bbc2b982e15e,DISK] 2023-02-19 08:00:54,517 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45051,DS-cce4edab-f6a8-4b9e-9743-9bcda05219b8,DISK] 2023-02-19 08:00:54,524 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/WALs/jenkins-hbase4.apache.org,33899,1676793653516/jenkins-hbase4.apache.org%2C33899%2C1676793653516.1676793654498 2023-02-19 08:00:54,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40567,DS-618f88bf-a4f3-4e06-9d18-bbc2b982e15e,DISK], DatanodeInfoWithStorage[127.0.0.1:45051,DS-cce4edab-f6a8-4b9e-9743-9bcda05219b8,DISK]] 2023-02-19 08:00:54,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 519140e60f29101a7add9f8dc53d77c6, NAME => 'hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:54,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:54,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:54,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:54,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:54,527 INFO [StoreOpener-519140e60f29101a7add9f8dc53d77c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:54,528 DEBUG [StoreOpener-519140e60f29101a7add9f8dc53d77c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6/info 2023-02-19 08:00:54,528 DEBUG [StoreOpener-519140e60f29101a7add9f8dc53d77c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6/info 2023-02-19 08:00:54,528 INFO [StoreOpener-519140e60f29101a7add9f8dc53d77c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 519140e60f29101a7add9f8dc53d77c6 columnFamilyName info 2023-02-19 08:00:54,528 INFO [StoreOpener-519140e60f29101a7add9f8dc53d77c6-1] regionserver.HStore(310): Store=519140e60f29101a7add9f8dc53d77c6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:54,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:54,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:54,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:54,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:54,533 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 519140e60f29101a7add9f8dc53d77c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62781185, jitterRate=-0.06448744237422943}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-19 08:00:54,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 519140e60f29101a7add9f8dc53d77c6: 2023-02-19 08:00:54,533 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6., pid=6, masterSystemTime=1676793654491 2023-02-19 08:00:54,537 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:54,537 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:54,537 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=519140e60f29101a7add9f8dc53d77c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:54,537 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676793654537"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793654537"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793654537"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793654537"}]},"ts":"1676793654537"} 2023-02-19 08:00:54,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-19 08:00:54,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 519140e60f29101a7add9f8dc53d77c6, server=jenkins-hbase4.apache.org,33899,1676793653516 in 200 msec 2023-02-19 08:00:54,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-19 08:00:54,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=519140e60f29101a7add9f8dc53d77c6, ASSIGN in 356 msec 2023-02-19 08:00:54,541 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:54,541 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793654541"}]},"ts":"1676793654541"} 2023-02-19 08:00:54,542 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-19 08:00:54,544 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:54,545 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 391 msec 2023-02-19 08:00:54,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-19 08:00:54,556 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:54,556 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:54,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:54,559 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43940, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:54,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-19 08:00:54,566 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:54,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 7 msec 2023-02-19 08:00:54,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-19 08:00:54,577 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-19 08:00:54,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-19 08:00:54,585 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-19 08:00:54,588 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-19 08:00:54,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.975sec 2023-02-19 08:00:54,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-19 08:00:54,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-19 08:00:54,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-19 08:00:54,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41907,1676793653468-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-19 08:00:54,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41907,1676793653468-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-19 08:00:54,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-19 08:00:54,605 DEBUG [Listener at localhost/43261] zookeeper.ReadOnlyZKClient(139): Connect 0x15519c2c to 127.0.0.1:58569 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:54,607 DEBUG [Listener at localhost/43261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a1ab1ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:54,608 DEBUG [hconnection-0x4492e1d5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:54,609 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47056, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:54,610 INFO [Listener at localhost/43261] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41907,1676793653468 2023-02-19 08:00:54,611 DEBUG [Listener at localhost/43261] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-19 08:00:54,613 DEBUG [Listener at localhost/43261] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-19 08:00:54,614 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35130, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-19 08:00:54,614 INFO [Listener at localhost/43261] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 08:00:54,614 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 08:00:54,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-19 08:00:54,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:35130 deadline: 1676793714614, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-19 08:00:54,615 INFO [Listener at localhost/43261] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-19 08:00:54,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-19 08:00:54,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-19 08:00:54,619 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-19 08:00:54,619 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-19 08:00:54,619 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-19 08:00:54,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:54,620 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:54,621 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b empty. 2023-02-19 08:00:54,621 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:54,621 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 08:00:54,628 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-19 08:00:54,629 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d5d6f3cb8906f8e855678e74cc41ac9b, NAME => 'testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp 2023-02-19 08:00:54,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:54,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d5d6f3cb8906f8e855678e74cc41ac9b, disabling compactions & flushes 2023-02-19 08:00:54,634 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:54,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:54,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. after waiting 0 ms 2023-02-19 08:00:54,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:54,634 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:54,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d5d6f3cb8906f8e855678e74cc41ac9b: 2023-02-19 08:00:54,636 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-19 08:00:54,636 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676793654636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793654636"}]},"ts":"1676793654636"} 2023-02-19 08:00:54,637 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-19 08:00:54,638 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-19 08:00:54,638 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793654638"}]},"ts":"1676793654638"} 2023-02-19 08:00:54,639 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-19 08:00:54,642 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-19 08:00:54,643 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-19 08:00:54,643 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-19 08:00:54,643 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-19 08:00:54,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d5d6f3cb8906f8e855678e74cc41ac9b, ASSIGN}] 2023-02-19 08:00:54,645 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d5d6f3cb8906f8e855678e74cc41ac9b, ASSIGN 2023-02-19 08:00:54,646 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d5d6f3cb8906f8e855678e74cc41ac9b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33899,1676793653516; forceNewPlan=false, retain=false 2023-02-19 08:00:54,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:54,796 INFO [jenkins-hbase4:41907] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-19 08:00:54,797 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d5d6f3cb8906f8e855678e74cc41ac9b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:54,797 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676793654797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793654797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793654797"}]},"ts":"1676793654797"} 2023-02-19 08:00:54,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure d5d6f3cb8906f8e855678e74cc41ac9b, server=jenkins-hbase4.apache.org,33899,1676793653516}] 2023-02-19 08:00:54,874 INFO [RS:1;jenkins-hbase4:46731] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46731%2C1676793653537, suffix=, logDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/WALs/jenkins-hbase4.apache.org,46731,1676793653537, archiveDir=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/oldWALs, maxLogs=32 2023-02-19 08:00:54,887 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40567,DS-618f88bf-a4f3-4e06-9d18-bbc2b982e15e,DISK] 2023-02-19 08:00:54,887 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45051,DS-cce4edab-f6a8-4b9e-9743-9bcda05219b8,DISK] 2023-02-19 08:00:54,889 INFO [RS:1;jenkins-hbase4:46731] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/WALs/jenkins-hbase4.apache.org,46731,1676793653537/jenkins-hbase4.apache.org%2C46731%2C1676793653537.1676793654874 2023-02-19 08:00:54,889 DEBUG [RS:1;jenkins-hbase4:46731] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40567,DS-618f88bf-a4f3-4e06-9d18-bbc2b982e15e,DISK], DatanodeInfoWithStorage[127.0.0.1:45051,DS-cce4edab-f6a8-4b9e-9743-9bcda05219b8,DISK]] 2023-02-19 08:00:54,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:54,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:54,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d5d6f3cb8906f8e855678e74cc41ac9b, NAME => 'testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.', STARTKEY => '', ENDKEY => ''} 2023-02-19 08:00:54,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:54,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:54,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:54,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:54,954 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:54,956 DEBUG [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1 2023-02-19 08:00:54,956 DEBUG [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1 2023-02-19 08:00:54,956 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5d6f3cb8906f8e855678e74cc41ac9b columnFamilyName f1 2023-02-19 08:00:54,956 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] regionserver.HStore(310): Store=d5d6f3cb8906f8e855678e74cc41ac9b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:54,957 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:54,958 DEBUG [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2 2023-02-19 08:00:54,958 DEBUG [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2 2023-02-19 08:00:54,958 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5d6f3cb8906f8e855678e74cc41ac9b columnFamilyName f2 2023-02-19 08:00:54,958 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] regionserver.HStore(310): Store=d5d6f3cb8906f8e855678e74cc41ac9b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:54,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:54,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:54,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:54,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:54,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-19 08:00:54,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d5d6f3cb8906f8e855678e74cc41ac9b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71543545, jitterRate=0.06608189642429352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:54,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d5d6f3cb8906f8e855678e74cc41ac9b: 2023-02-19 08:00:54,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b., pid=12, masterSystemTime=1676793654950 2023-02-19 08:00:54,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:54,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:54,966 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d5d6f3cb8906f8e855678e74cc41ac9b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:54,966 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676793654966"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676793654966"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676793654966"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676793654966"}]},"ts":"1676793654966"} 2023-02-19 08:00:54,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-19 08:00:54,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure d5d6f3cb8906f8e855678e74cc41ac9b, server=jenkins-hbase4.apache.org,33899,1676793653516 in 170 msec 2023-02-19 08:00:54,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-19 08:00:54,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d5d6f3cb8906f8e855678e74cc41ac9b, ASSIGN in 326 msec 2023-02-19 08:00:54,971 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-19 08:00:54,971 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793654971"}]},"ts":"1676793654971"} 2023-02-19 08:00:54,972 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-19 08:00:54,976 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-19 08:00:54,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 359 msec 2023-02-19 08:00:55,053 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-19 08:00:55,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-19 08:00:55,224 INFO [Listener at localhost/43261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-19 08:00:55,224 DEBUG [Listener at localhost/43261] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-19 08:00:55,224 INFO [Listener at localhost/43261] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:55,226 INFO [Listener at localhost/43261] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-19 08:00:55,226 INFO [Listener at localhost/43261] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-19 08:00:55,226 INFO [Listener at localhost/43261] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-19 08:00:55,226 INFO [Listener at localhost/43261] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-19 08:00:55,241 DEBUG [hconnection-0x4492e1d5-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:55,255 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43950, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:55,264 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33899] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:55,366 INFO [Listener at localhost/43261] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-19 08:00:55,366 INFO [Listener at localhost/43261] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-19 08:00:55,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 08:00:55,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676793655367 (current time:1676793655367). 2023-02-19 08:00:55,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-19 08:00:55,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] zookeeper.ReadOnlyZKClient(139): Connect 0x183f56ff to 127.0.0.1:58569 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-19 08:00:55,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2035c4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-19 08:00:55,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-19 08:00:55,373 INFO [RS-EventLoopGroup-23-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-19 08:00:55,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x183f56ff to 127.0.0.1:58569 2023-02-19 08:00:55,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:55,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-19 08:00:55,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 08:00:55,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 08:00:55,377 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 08:00:55,378 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676794255378 2023-02-19 08:00:55,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-19 08:00:55,378 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-19 08:00:55,381 DEBUG [Listener at localhost/43261] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:55,381 DEBUG [Listener at localhost/43261] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-19 08:00:55,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 08:00:55,384 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-19 08:00:55,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 9 msec 2023-02-19 08:00:55,386 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 08:00:55,386 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676794255386 2023-02-19 08:00:55,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-19 08:00:55,395 INFO [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-19 08:00:55,395 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:55,396 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-19 08:00:55,396 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-19 08:00:55,397 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,397 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 08:00:55,398 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:55,398 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:55,398 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:55,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 08:00:55,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-19 08:00:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 08:00:55,400 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,400 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:55,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 08:00:55,400 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-19 08:00:55,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-19 08:00:55,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,400 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-19 08:00:55,400 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:55,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-19 08:00:55,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 08:00:55,400 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-19 08:00:55,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-19 08:00:55,401 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-19 08:00:55,401 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-19 08:00:55,407 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 08:00:55,407 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-19 08:00:55,407 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-19 08:00:55,407 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-19 08:00:55,407 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46731,1676793653537' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-19 08:00:55,407 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33899,1676793653516' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-19 08:00:55,410 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,410 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:55,410 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,411 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,411 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:55,411 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:55,411 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 08:00:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:55,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33899,1676793653516' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-19 08:00:55,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c7692d2[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:55,413 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-19 08:00:55,413 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,414 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,414 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,415 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 08:00:55,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,415 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-19 08:00:55,415 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-19 08:00:55,415 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46731,1676793653537' in zk 2023-02-19 08:00:55,415 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-19 08:00:55,415 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-19 08:00:55,415 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:55,415 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,415 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:55,415 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. started... 2023-02-19 08:00:55,416 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d5d6f3cb8906f8e855678e74cc41ac9b 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-19 08:00:55,416 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-19 08:00:55,416 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:55,416 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-19 08:00:55,436 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/.tmp/f1/0c4b682e3b374ad9bd81e7e318debb59 2023-02-19 08:00:55,457 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/.tmp/f2/9be4eebb24d74c1eb40574225e923110 2023-02-19 08:00:55,461 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/.tmp/f1/0c4b682e3b374ad9bd81e7e318debb59 as hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/0c4b682e3b374ad9bd81e7e318debb59 2023-02-19 08:00:55,465 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/0c4b682e3b374ad9bd81e7e318debb59, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 08:00:55,465 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/.tmp/f2/9be4eebb24d74c1eb40574225e923110 as hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/9be4eebb24d74c1eb40574225e923110 2023-02-19 08:00:55,469 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/9be4eebb24d74c1eb40574225e923110, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-19 08:00:55,470 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for d5d6f3cb8906f8e855678e74cc41ac9b in 55ms, sequenceid=5, compaction requested=false 2023-02-19 08:00:55,470 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-19 08:00:55,470 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d5d6f3cb8906f8e855678e74cc41ac9b: 2023-02-19 08:00:55,471 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-19 08:00:55,471 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-19 08:00:55,471 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/0c4b682e3b374ad9bd81e7e318debb59] hfiles 2023-02-19 08:00:55,471 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/0c4b682e3b374ad9bd81e7e318debb59 for snapshot=testWithMapReduceSingleRegion 2023-02-19 08:00:55,471 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/9be4eebb24d74c1eb40574225e923110] hfiles 2023-02-19 08:00:55,471 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/9be4eebb24d74c1eb40574225e923110 for snapshot=testWithMapReduceSingleRegion 2023-02-19 08:00:55,481 DEBUG [Listener at localhost/43261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:55,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:55,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-19 08:00:55,483 DEBUG [Listener at localhost/43261] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-19 08:00:55,490 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. completed. 2023-02-19 08:00:55,490 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:55,490 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-19 08:00:55,490 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-19 08:00:55,490 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,490 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-19 08:00:55,490 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33899,1676793653516' in zk 2023-02-19 08:00:55,491 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,491 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-19 08:00:55,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,491 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:55,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:55,492 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-19 08:00:55,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:55,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:55,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:55,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 08:00:55,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:55,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 08:00:55,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33899,1676793653516': 2023-02-19 08:00:55,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33899,1676793653516' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-19 08:00:55,494 INFO [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-19 08:00:55,494 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:55,494 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:55,494 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-19 08:00:55,495 INFO [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-19 08:00:55,497 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,497 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,497 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,497 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:55,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,497 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-19 08:00:55,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:55,498 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:55,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:55,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:55,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:55,498 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 08:00:55,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:55,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 08:00:55,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,500 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:55,500 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-19 08:00:55,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,505 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,505 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 08:00:55,505 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,505 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-19 08:00:55,505 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:55,505 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:55,505 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:55,505 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,505 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-19 08:00:55,505 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-19 08:00:55,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-19 08:00:55,506 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-19 08:00:55,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:55,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:55,505 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-19 08:00:55,506 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,506 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-19 08:00:55,506 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-19 08:00:55,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:55,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:55,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-19 08:00:55,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-19 08:00:55,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-19 08:00:55,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-19 08:00:55,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-19 08:00:55,561 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-19 08:00:55,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-19 08:00:55,562 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-19 08:00:55,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676793655378Consolidate snapshot: testWithMapReduceSingleRegion at 1676793655506 (+128 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676793655506Writing data manifest for testWithMapReduceSingleRegion at 1676793655509 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676793655531 (+22 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676793655561 (+30 ms) 2023-02-19 08:00:55,562 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-19 08:00:55,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 181 msec 2023-02-19 08:00:55,683 DEBUG [Listener at localhost/43261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-19 08:00:55,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-19 08:00:55,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-19 08:00:55,685 INFO [Listener at localhost/43261] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-19 08:00:55,688 INFO [Listener at localhost/43261] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-19 08:00:55,694 INFO [Listener at localhost/43261] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-19 08:00:55,720 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33899] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:55,799 INFO [Listener at localhost/43261] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-19 08:00:55,803 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-19 08:00:55,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-19 08:00:55,805 INFO [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-19 08:00:55,805 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:55,805 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-19 08:00:55,805 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-19 08:00:55,805 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,805 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:55,807 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:55,807 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:55,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:55,807 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:55,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:55,807 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:55,807 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-19 08:00:55,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:55,808 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 08:00:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-19 08:00:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:55,808 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-19 08:00:55,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 08:00:55,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-19 08:00:55,808 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 08:00:55,808 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:55,808 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-19 08:00:55,808 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-19 08:00:55,808 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 08:00:55,808 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-19 08:00:55,808 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 08:00:55,808 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46731,1676793653537' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 08:00:55,808 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-19 08:00:55,809 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-19 08:00:55,809 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:55,809 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. started... 2023-02-19 08:00:55,809 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d5d6f3cb8906f8e855678e74cc41ac9b 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-19 08:00:55,810 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,810 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,810 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:55,824 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/.tmp/f1/fcf2e0a959d9466892ec3dcac3a9fad3 2023-02-19 08:00:55,843 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/.tmp/f2/37702f638c6f4d0b87f6be7a1b1202ea 2023-02-19 08:00:55,846 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/.tmp/f1/fcf2e0a959d9466892ec3dcac3a9fad3 as hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/fcf2e0a959d9466892ec3dcac3a9fad3 2023-02-19 08:00:55,851 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/fcf2e0a959d9466892ec3dcac3a9fad3, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 08:00:55,852 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/.tmp/f2/37702f638c6f4d0b87f6be7a1b1202ea as hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/37702f638c6f4d0b87f6be7a1b1202ea 2023-02-19 08:00:55,861 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/37702f638c6f4d0b87f6be7a1b1202ea, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-19 08:00:55,862 INFO [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for d5d6f3cb8906f8e855678e74cc41ac9b in 53ms, sequenceid=9, compaction requested=false 2023-02-19 08:00:55,863 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d5d6f3cb8906f8e855678e74cc41ac9b: 2023-02-19 08:00:55,863 DEBUG [rs(jenkins-hbase4.apache.org,33899,1676793653516)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:55,863 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-19 08:00:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-19 08:00:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-19 08:00:55,864 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33899,1676793653516' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-19 08:00:55,866 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,866 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:55,866 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,866 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-19 08:00:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:55,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:55,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33899,1676793653516' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-19 08:00:55,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48491f84[Count = 0] remaining members to acquire global barrier 2023-02-19 08:00:55,868 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-19 08:00:55,869 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,870 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,870 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,870 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 08:00:55,870 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 08:00:55,870 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46731,1676793653537' in zk 2023-02-19 08:00:55,870 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,870 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-19 08:00:55,870 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-19 08:00:55,870 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-19 08:00:55,870 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,33899,1676793653516' in zk 2023-02-19 08:00:55,872 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,872 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 08:00:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:55,872 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:55,872 DEBUG [member: 'jenkins-hbase4.apache.org,33899,1676793653516' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 08:00:55,873 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-19 08:00:55,873 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:55,873 DEBUG [member: 'jenkins-hbase4.apache.org,46731,1676793653537' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-19 08:00:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:55,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:55,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,33899,1676793653516': 2023-02-19 08:00:55,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33899,1676793653516' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-19 08:00:55,876 INFO [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-19 08:00:55,876 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-19 08:00:55,876 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-19 08:00:55,876 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-19 08:00:55,876 INFO [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-19 08:00:55,879 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,879 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,879 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,879 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,879 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:55,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-19 08:00:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-19 08:00:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,880 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-19 08:00:55,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:55,881 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-19 08:00:55,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:55,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,882 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-19 08:00:55,883 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-19 08:00:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,886 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:55,886 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:55,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:55,886 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-19 08:00:55,886 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-19 08:00:55,886 DEBUG [(jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-19 08:00:55,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-19 08:00:55,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:55,886 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-19 08:00:55,886 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-19 08:00:55,886 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-19 08:00:55,886 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:55,886 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,886 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-19 08:00:55,886 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:55,887 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:55,887 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:55,887 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-19 08:00:55,887 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-19 08:00:55,887 DEBUG [Listener at localhost/43261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-19 08:00:55,887 DEBUG [Listener at localhost/43261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-19 08:00:55,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-19 08:00:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-19 08:00:55,987 DEBUG [Listener at localhost/43261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-19 08:00:55,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-19 08:00:56,094 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/hadoop-8012278276306269158.jar 2023-02-19 08:00:56,098 INFO [Listener at localhost/43261] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676793655367 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:56,098 DEBUG [Listener at localhost/43261] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46177/user/jenkins/test-data/ffc4c943-da00-6d11-2403-df415e046ae9/testWithMapReduceSingleRegion/246bd77c-68b6-4333-8901-e6ed32660014/data/default/testWithMapReduce 2023-02-19 08:00:56,099 INFO [Listener at localhost/43261] snapshot.RestoreSnapshotHelper(239): region to add: d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:56,099 INFO [Listener at localhost/43261] snapshot.RestoreSnapshotHelper(585): clone region=d5d6f3cb8906f8e855678e74cc41ac9b as d5d6f3cb8906f8e855678e74cc41ac9b in snapshot testWithMapReduceSingleRegion 2023-02-19 08:00:56,099 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d5d6f3cb8906f8e855678e74cc41ac9b, NAME => 'testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46177/user/jenkins/test-data/ffc4c943-da00-6d11-2403-df415e046ae9/testWithMapReduceSingleRegion/246bd77c-68b6-4333-8901-e6ed32660014 2023-02-19 08:00:56,105 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:56,105 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0c4b682e3b374ad9bd81e7e318debb59 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-19 08:00:56,107 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9be4eebb24d74c1eb40574225e923110 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-19 08:00:56,108 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d5d6f3cb8906f8e855678e74cc41ac9b, disabling compactions & flushes 2023-02-19 08:00:56,108 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:56,108 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:56,108 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. after waiting 0 ms 2023-02-19 08:00:56,108 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:56,108 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:56,108 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d5d6f3cb8906f8e855678e74cc41ac9b: 2023-02-19 08:00:56,108 INFO [Listener at localhost/43261] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676793655367 type: FLUSH version: 2 ttl: 0 2023-02-19 08:00:56,109 DEBUG [Listener at localhost/43261] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46177/user/jenkins/test-data/ffc4c943-da00-6d11-2403-df415e046ae9/testWithMapReduceSingleRegion/246bd77c-68b6-4333-8901-e6ed32660014 2023-02-19 08:00:56,109 DEBUG [Listener at localhost/43261] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46177/user/jenkins/test-data/ffc4c943-da00-6d11-2403-df415e046ae9/testWithMapReduceSingleRegion/246bd77c-68b6-4333-8901-e6ed32660014 2023-02-19 08:00:56,109 DEBUG [Listener at localhost/43261] util.CommonFSUtils(699): |-data/ 2023-02-19 08:00:56,109 DEBUG [Listener at localhost/43261] util.CommonFSUtils(699): |----default/ 2023-02-19 08:00:56,110 DEBUG [Listener at localhost/43261] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-19 08:00:56,110 DEBUG [Listener at localhost/43261] util.CommonFSUtils(699): |----------d5d6f3cb8906f8e855678e74cc41ac9b/ 2023-02-19 08:00:56,110 DEBUG [Listener at localhost/43261] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-19 08:00:56,110 DEBUG [Listener at localhost/43261] util.CommonFSUtils(699): |-------------f1/ 2023-02-19 08:00:56,111 DEBUG [Listener at localhost/43261] util.CommonFSUtils(702): |----------------testWithMapReduce=d5d6f3cb8906f8e855678e74cc41ac9b-0c4b682e3b374ad9bd81e7e318debb59 2023-02-19 08:00:56,111 DEBUG [Listener at localhost/43261] util.CommonFSUtils(699): |-------------f2/ 2023-02-19 08:00:56,111 DEBUG [Listener at localhost/43261] util.CommonFSUtils(702): |----------------testWithMapReduce=d5d6f3cb8906f8e855678e74cc41ac9b-9be4eebb24d74c1eb40574225e923110 2023-02-19 08:00:56,112 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,112 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,112 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,113 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,113 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,113 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,113 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,182 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/hadoop-78716546826264349.jar 2023-02-19 08:00:56,183 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,183 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,183 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,184 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,184 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,184 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,185 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-19 08:00:56,185 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-19 08:00:56,185 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-19 08:00:56,186 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-19 08:00:56,186 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-19 08:00:56,186 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-19 08:00:56,187 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-19 08:00:56,187 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-19 08:00:56,187 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-19 08:00:56,188 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-19 08:00:56,188 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-19 08:00:56,189 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 08:00:56,189 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 08:00:56,189 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-19 08:00:56,189 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 08:00:56,255 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/hadoop-172125968088088179.jar 2023-02-19 08:00:56,256 DEBUG [Listener at localhost/43261] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-19 08:00:56,261 WARN [Listener at localhost/43261] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-19 08:00:56,295 INFO [Listener at localhost/43261] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-19 08:00:56,381 WARN [Listener at localhost/43261] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/mapreduce.cluster.local.dir/1676793656346/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-19 08:00:56,381 WARN [Listener at localhost/43261] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/mapreduce.cluster.local.dir/1676793656346/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-19 08:00:56,411 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-19 08:00:56,412 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-19 08:00:56,412 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-19 08:00:56,414 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:56,414 DEBUG [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/ffc4c943-da00-6d11-2403-df415e046ae9/testWithMapReduceSingleRegion/246bd77c-68b6-4333-8901-e6ed32660014/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1 2023-02-19 08:00:56,415 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5d6f3cb8906f8e855678e74cc41ac9b columnFamilyName f1 2023-02-19 08:00:56,419 DEBUG [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] regionserver.HStore(539): loaded hdfs://localhost:46177/user/jenkins/test-data/ffc4c943-da00-6d11-2403-df415e046ae9/testWithMapReduceSingleRegion/246bd77c-68b6-4333-8901-e6ed32660014/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/testWithMapReduce=d5d6f3cb8906f8e855678e74cc41ac9b-0c4b682e3b374ad9bd81e7e318debb59 2023-02-19 08:00:56,419 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] regionserver.HStore(310): Store=d5d6f3cb8906f8e855678e74cc41ac9b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:56,419 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:56,420 DEBUG [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46177/user/jenkins/test-data/ffc4c943-da00-6d11-2403-df415e046ae9/testWithMapReduceSingleRegion/246bd77c-68b6-4333-8901-e6ed32660014/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2 2023-02-19 08:00:56,420 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5d6f3cb8906f8e855678e74cc41ac9b columnFamilyName f2 2023-02-19 08:00:56,426 DEBUG [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] regionserver.HStore(539): loaded hdfs://localhost:46177/user/jenkins/test-data/ffc4c943-da00-6d11-2403-df415e046ae9/testWithMapReduceSingleRegion/246bd77c-68b6-4333-8901-e6ed32660014/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/testWithMapReduce=d5d6f3cb8906f8e855678e74cc41ac9b-9be4eebb24d74c1eb40574225e923110 2023-02-19 08:00:56,426 INFO [StoreOpener-d5d6f3cb8906f8e855678e74cc41ac9b-1] regionserver.HStore(310): Store=d5d6f3cb8906f8e855678e74cc41ac9b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-19 08:00:56,427 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-19 08:00:56,427 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d5d6f3cb8906f8e855678e74cc41ac9b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74708337, jitterRate=0.11324097216129303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-19 08:00:56,427 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d5d6f3cb8906f8e855678e74cc41ac9b: 2023-02-19 08:00:56,569 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d5d6f3cb8906f8e855678e74cc41ac9b, disabling compactions & flushes 2023-02-19 08:00:56,569 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:56,569 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:56,569 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. after waiting 0 ms 2023-02-19 08:00:56,569 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:56,570 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:56,570 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d5d6f3cb8906f8e855678e74cc41ac9b: 2023-02-19 08:00:57,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-19 08:00:57,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-19 08:00:57,418 INFO [Listener at localhost/43261] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-19 08:00:57,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-19 08:00:57,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-19 08:00:57,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:57,421 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793657421"}]},"ts":"1676793657421"} 2023-02-19 08:00:57,422 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-19 08:00:57,424 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-19 08:00:57,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d5d6f3cb8906f8e855678e74cc41ac9b, UNASSIGN}] 2023-02-19 08:00:57,425 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d5d6f3cb8906f8e855678e74cc41ac9b, UNASSIGN 2023-02-19 08:00:57,425 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d5d6f3cb8906f8e855678e74cc41ac9b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:57,425 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676793657425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676793657425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676793657425"}]},"ts":"1676793657425"} 2023-02-19 08:00:57,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure d5d6f3cb8906f8e855678e74cc41ac9b, server=jenkins-hbase4.apache.org,33899,1676793653516}] 2023-02-19 08:00:57,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:57,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:57,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d5d6f3cb8906f8e855678e74cc41ac9b, disabling compactions & flushes 2023-02-19 08:00:57,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:57,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:57,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. after waiting 0 ms 2023-02-19 08:00:57,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:57,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-19 08:00:57,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b. 2023-02-19 08:00:57,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d5d6f3cb8906f8e855678e74cc41ac9b: 2023-02-19 08:00:57,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:57,584 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d5d6f3cb8906f8e855678e74cc41ac9b, regionState=CLOSED 2023-02-19 08:00:57,584 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676793657584"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676793657584"}]},"ts":"1676793657584"} 2023-02-19 08:00:57,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-19 08:00:57,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure d5d6f3cb8906f8e855678e74cc41ac9b, server=jenkins-hbase4.apache.org,33899,1676793653516 in 159 msec 2023-02-19 08:00:57,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-19 08:00:57,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d5d6f3cb8906f8e855678e74cc41ac9b, UNASSIGN in 162 msec 2023-02-19 08:00:57,588 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676793657588"}]},"ts":"1676793657588"} 2023-02-19 08:00:57,589 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-19 08:00:57,590 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-19 08:00:57,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 172 msec 2023-02-19 08:00:57,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-19 08:00:57,724 INFO [Listener at localhost/43261] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-19 08:00:57,724 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-19 08:00:57,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:57,727 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:57,727 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:57,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 08:00:57,730 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:57,731 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1, FileablePath, hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2, FileablePath, hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/recovered.edits] 2023-02-19 08:00:57,734 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/0c4b682e3b374ad9bd81e7e318debb59 to hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/archive/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/0c4b682e3b374ad9bd81e7e318debb59 2023-02-19 08:00:57,735 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/fcf2e0a959d9466892ec3dcac3a9fad3 to hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/archive/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f1/fcf2e0a959d9466892ec3dcac3a9fad3 2023-02-19 08:00:57,737 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/37702f638c6f4d0b87f6be7a1b1202ea to hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/archive/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/37702f638c6f4d0b87f6be7a1b1202ea 2023-02-19 08:00:57,738 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/9be4eebb24d74c1eb40574225e923110 to hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/archive/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/f2/9be4eebb24d74c1eb40574225e923110 2023-02-19 08:00:57,739 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/recovered.edits/12.seqid to hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/archive/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b/recovered.edits/12.seqid 2023-02-19 08:00:57,740 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/.tmp/data/default/testWithMapReduce/d5d6f3cb8906f8e855678e74cc41ac9b 2023-02-19 08:00:57,740 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-19 08:00:57,741 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:57,743 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-19 08:00:57,744 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-19 08:00:57,745 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:57,745 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-19 08:00:57,745 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676793657745"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:57,746 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-19 08:00:57,746 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d5d6f3cb8906f8e855678e74cc41ac9b, NAME => 'testWithMapReduce,,1676793654617.d5d6f3cb8906f8e855678e74cc41ac9b.', STARTKEY => '', ENDKEY => ''}] 2023-02-19 08:00:57,747 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-19 08:00:57,747 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676793657747"}]},"ts":"9223372036854775807"} 2023-02-19 08:00:57,748 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-19 08:00:57,750 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-19 08:00:57,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 26 msec 2023-02-19 08:00:57,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41907] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-19 08:00:57,829 INFO [Listener at localhost/43261] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-19 08:00:57,829 INFO [Listener at localhost/43261] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-19 08:00:57,829 INFO [Listener at localhost/43261] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-19 08:00:57,829 DEBUG [Listener at localhost/43261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15519c2c to 127.0.0.1:58569 2023-02-19 08:00:57,829 DEBUG [Listener at localhost/43261] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:57,830 DEBUG [Listener at localhost/43261] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-19 08:00:57,830 DEBUG [Listener at localhost/43261] util.JVMClusterUtil(257): Found active master hash=472825250, stopped=false 2023-02-19 08:00:57,830 INFO [Listener at localhost/43261] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41907,1676793653468 2023-02-19 08:00:57,831 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:57,831 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:57,831 INFO [Listener at localhost/43261] procedure2.ProcedureExecutor(629): Stopping 2023-02-19 08:00:57,831 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-19 08:00:57,831 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:57,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:57,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:57,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-19 08:00:57,834 DEBUG [Listener at localhost/43261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7609e18b to 127.0.0.1:58569 2023-02-19 08:00:57,834 DEBUG [Listener at localhost/43261] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:57,834 INFO [Listener at localhost/43261] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33899,1676793653516' ***** 2023-02-19 08:00:57,834 INFO [Listener at localhost/43261] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:57,834 INFO [Listener at localhost/43261] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46731,1676793653537' ***** 2023-02-19 08:00:57,834 INFO [Listener at localhost/43261] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-19 08:00:57,834 INFO [RS:0;jenkins-hbase4:33899] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:57,834 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:57,834 INFO [RS:1;jenkins-hbase4:46731] regionserver.HeapMemoryManager(220): Stopping 2023-02-19 08:00:57,834 INFO [RS:0;jenkins-hbase4:33899] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:57,835 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-19 08:00:57,835 INFO [RS:0;jenkins-hbase4:33899] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:57,835 INFO [RS:1;jenkins-hbase4:46731] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-19 08:00:57,835 INFO [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(3304): Received CLOSE for 519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:57,836 INFO [RS:1;jenkins-hbase4:46731] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-19 08:00:57,836 INFO [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:57,836 INFO [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:57,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 519140e60f29101a7add9f8dc53d77c6, disabling compactions & flushes 2023-02-19 08:00:57,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:57,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:57,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. after waiting 0 ms 2023-02-19 08:00:57,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:57,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 519140e60f29101a7add9f8dc53d77c6 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-19 08:00:57,836 DEBUG [RS:1;jenkins-hbase4:46731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x106db4a3 to 127.0.0.1:58569 2023-02-19 08:00:57,836 DEBUG [RS:0;jenkins-hbase4:33899] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ef16fc3 to 127.0.0.1:58569 2023-02-19 08:00:57,837 DEBUG [RS:1;jenkins-hbase4:46731] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:57,837 DEBUG [RS:0;jenkins-hbase4:33899] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:57,837 INFO [RS:1;jenkins-hbase4:46731] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:57,837 INFO [RS:1;jenkins-hbase4:46731] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:57,837 INFO [RS:1;jenkins-hbase4:46731] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:57,837 INFO [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 08:00:57,837 INFO [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-19 08:00:57,837 DEBUG [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1479): Online Regions={519140e60f29101a7add9f8dc53d77c6=hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6.} 2023-02-19 08:00:57,837 DEBUG [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1505): Waiting on 519140e60f29101a7add9f8dc53d77c6 2023-02-19 08:00:57,839 INFO [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-19 08:00:57,839 DEBUG [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-19 08:00:57,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-19 08:00:57,839 DEBUG [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-19 08:00:57,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-19 08:00:57,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-19 08:00:57,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-19 08:00:57,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-19 08:00:57,840 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-19 08:00:57,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6/.tmp/info/b19a27081d35477da9f832c7acd65af3 2023-02-19 08:00:57,851 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/.tmp/info/f8dde9b6487649119a146760798165c5 2023-02-19 08:00:57,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6/.tmp/info/b19a27081d35477da9f832c7acd65af3 as hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6/info/b19a27081d35477da9f832c7acd65af3 2023-02-19 08:00:57,854 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8dde9b6487649119a146760798165c5 2023-02-19 08:00:57,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6/info/b19a27081d35477da9f832c7acd65af3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-19 08:00:57,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 519140e60f29101a7add9f8dc53d77c6 in 21ms, sequenceid=6, compaction requested=false 2023-02-19 08:00:57,860 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/.tmp/rep_barrier/79533f834f3a4fa2bfd673908623f33d 2023-02-19 08:00:57,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/namespace/519140e60f29101a7add9f8dc53d77c6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-19 08:00:57,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:57,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 519140e60f29101a7add9f8dc53d77c6: 2023-02-19 08:00:57,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676793654153.519140e60f29101a7add9f8dc53d77c6. 2023-02-19 08:00:57,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79533f834f3a4fa2bfd673908623f33d 2023-02-19 08:00:57,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/.tmp/table/e38f58f0f4d74424abffed6dd4355d4b 2023-02-19 08:00:57,872 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e38f58f0f4d74424abffed6dd4355d4b 2023-02-19 08:00:57,873 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/.tmp/info/f8dde9b6487649119a146760798165c5 as hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/info/f8dde9b6487649119a146760798165c5 2023-02-19 08:00:57,875 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8dde9b6487649119a146760798165c5 2023-02-19 08:00:57,876 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/info/f8dde9b6487649119a146760798165c5, entries=12, sequenceid=21, filesize=6.2 K 2023-02-19 08:00:57,876 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/.tmp/rep_barrier/79533f834f3a4fa2bfd673908623f33d as hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/rep_barrier/79533f834f3a4fa2bfd673908623f33d 2023-02-19 08:00:57,878 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:57,879 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:57,881 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79533f834f3a4fa2bfd673908623f33d 2023-02-19 08:00:57,881 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/rep_barrier/79533f834f3a4fa2bfd673908623f33d, entries=1, sequenceid=21, filesize=5.0 K 2023-02-19 08:00:57,882 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/.tmp/table/e38f58f0f4d74424abffed6dd4355d4b as hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/table/e38f58f0f4d74424abffed6dd4355d4b 2023-02-19 08:00:57,885 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e38f58f0f4d74424abffed6dd4355d4b 2023-02-19 08:00:57,885 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/table/e38f58f0f4d74424abffed6dd4355d4b, entries=4, sequenceid=21, filesize=5.0 K 2023-02-19 08:00:57,885 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 45ms, sequenceid=21, compaction requested=false 2023-02-19 08:00:57,891 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-19 08:00:57,892 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-19 08:00:57,892 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:57,892 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-19 08:00:57,892 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-19 08:00:57,893 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 08:00:57,893 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 08:00:57,895 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-19 08:00:57,895 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-19 08:00:58,037 INFO [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33899,1676793653516; all regions closed. 2023-02-19 08:00:58,039 INFO [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46731,1676793653537; all regions closed. 2023-02-19 08:00:58,041 DEBUG [RS:0;jenkins-hbase4:33899] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/oldWALs 2023-02-19 08:00:58,041 INFO [RS:0;jenkins-hbase4:33899] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33899%2C1676793653516:(num 1676793654498) 2023-02-19 08:00:58,041 DEBUG [RS:0;jenkins-hbase4:33899] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:58,041 INFO [RS:0;jenkins-hbase4:33899] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:58,041 INFO [RS:0;jenkins-hbase4:33899] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:58,042 INFO [RS:0;jenkins-hbase4:33899] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-19 08:00:58,042 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:58,042 INFO [RS:0;jenkins-hbase4:33899] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-19 08:00:58,042 INFO [RS:0;jenkins-hbase4:33899] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-19 08:00:58,043 INFO [RS:0;jenkins-hbase4:33899] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33899 2023-02-19 08:00:58,044 DEBUG [RS:1;jenkins-hbase4:46731] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/oldWALs 2023-02-19 08:00:58,044 INFO [RS:1;jenkins-hbase4:46731] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46731%2C1676793653537.meta:.meta(num 1676793654105) 2023-02-19 08:00:58,044 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:58,044 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:58,044 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:58,044 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33899,1676793653516 2023-02-19 08:00:58,045 ERROR [Listener at localhost/43261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@41cbf976 rejected from java.util.concurrent.ThreadPoolExecutor@45f47597[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:58,045 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:58,045 ERROR [Listener at localhost/43261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2fa22e92 rejected from java.util.concurrent.ThreadPoolExecutor@45f47597[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:58,045 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33899,1676793653516] 2023-02-19 08:00:58,045 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33899,1676793653516; numProcessing=1 2023-02-19 08:00:58,046 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/WALs/jenkins-hbase4.apache.org,46731,1676793653537/jenkins-hbase4.apache.org%2C46731%2C1676793653537.1676793654874 not finished, retry = 0 2023-02-19 08:00:58,048 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33899,1676793653516 already deleted, retry=false 2023-02-19 08:00:58,048 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33899,1676793653516 expired; onlineServers=1 2023-02-19 08:00:58,148 DEBUG [RS:1;jenkins-hbase4:46731] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/oldWALs 2023-02-19 08:00:58,149 INFO [RS:1;jenkins-hbase4:46731] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46731%2C1676793653537:(num 1676793654874) 2023-02-19 08:00:58,149 DEBUG [RS:1;jenkins-hbase4:46731] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:58,149 INFO [RS:1;jenkins-hbase4:46731] regionserver.LeaseManager(133): Closed leases 2023-02-19 08:00:58,149 INFO [RS:1;jenkins-hbase4:46731] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-19 08:00:58,149 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:58,151 INFO [RS:1;jenkins-hbase4:46731] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46731 2023-02-19 08:00:58,153 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46731,1676793653537 2023-02-19 08:00:58,153 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-19 08:00:58,153 ERROR [Listener at localhost/43261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52239a11 rejected from java.util.concurrent.ThreadPoolExecutor@561c148d[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:58,154 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46731,1676793653537] 2023-02-19 08:00:58,154 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46731,1676793653537; numProcessing=2 2023-02-19 08:00:58,155 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46731,1676793653537 already deleted, retry=false 2023-02-19 08:00:58,155 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46731,1676793653537 expired; onlineServers=0 2023-02-19 08:00:58,155 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41907,1676793653468' ***** 2023-02-19 08:00:58,155 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-19 08:00:58,156 DEBUG [M:0;jenkins-hbase4:41907] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18113aff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-19 08:00:58,156 INFO [M:0;jenkins-hbase4:41907] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41907,1676793653468 2023-02-19 08:00:58,156 INFO [M:0;jenkins-hbase4:41907] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41907,1676793653468; all regions closed. 2023-02-19 08:00:58,156 DEBUG [M:0;jenkins-hbase4:41907] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-19 08:00:58,156 DEBUG [M:0;jenkins-hbase4:41907] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-19 08:00:58,156 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-19 08:00:58,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793653758] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676793653758,5,FailOnTimeoutGroup] 2023-02-19 08:00:58,156 DEBUG [M:0;jenkins-hbase4:41907] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-19 08:00:58,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793653758] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676793653758,5,FailOnTimeoutGroup] 2023-02-19 08:00:58,157 INFO [M:0;jenkins-hbase4:41907] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-19 08:00:58,157 INFO [M:0;jenkins-hbase4:41907] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-19 08:00:58,157 INFO [M:0;jenkins-hbase4:41907] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-19 08:00:58,157 DEBUG [M:0;jenkins-hbase4:41907] master.HMaster(1512): Stopping service threads 2023-02-19 08:00:58,157 INFO [M:0;jenkins-hbase4:41907] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-19 08:00:58,158 ERROR [M:0;jenkins-hbase4:41907] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-19 08:00:58,158 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-19 08:00:58,158 INFO [M:0;jenkins-hbase4:41907] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-19 08:00:58,158 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-19 08:00:58,158 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-19 08:00:58,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-19 08:00:58,159 DEBUG [M:0;jenkins-hbase4:41907] zookeeper.ZKUtil(398): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-19 08:00:58,159 WARN [M:0;jenkins-hbase4:41907] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-19 08:00:58,159 INFO [M:0;jenkins-hbase4:41907] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-19 08:00:58,159 INFO [M:0;jenkins-hbase4:41907] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-19 08:00:58,159 DEBUG [M:0;jenkins-hbase4:41907] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-19 08:00:58,159 INFO [M:0;jenkins-hbase4:41907] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:58,159 DEBUG [M:0;jenkins-hbase4:41907] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:58,159 DEBUG [M:0;jenkins-hbase4:41907] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-19 08:00:58,159 DEBUG [M:0;jenkins-hbase4:41907] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:58,159 INFO [M:0;jenkins-hbase4:41907] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.66 KB heapSize=65.63 KB 2023-02-19 08:00:58,169 INFO [M:0;jenkins-hbase4:41907] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.66 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c1d66f121af40f2b56a80ac517577d4 2023-02-19 08:00:58,173 DEBUG [M:0;jenkins-hbase4:41907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c1d66f121af40f2b56a80ac517577d4 as hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c1d66f121af40f2b56a80ac517577d4 2023-02-19 08:00:58,176 INFO [M:0;jenkins-hbase4:41907] regionserver.HStore(1080): Added hdfs://localhost:46177/user/jenkins/test-data/626199c0-0ce2-96a6-5584-1009d3bf621b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c1d66f121af40f2b56a80ac517577d4, entries=17, sequenceid=132, filesize=8.6 K 2023-02-19 08:00:58,177 INFO [M:0;jenkins-hbase4:41907] regionserver.HRegion(2947): Finished flush of dataSize ~54.66 KB/55975, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-19 08:00:58,177 INFO [M:0;jenkins-hbase4:41907] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-19 08:00:58,177 DEBUG [M:0;jenkins-hbase4:41907] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-19 08:00:58,179 INFO [M:0;jenkins-hbase4:41907] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-19 08:00:58,179 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-19 08:00:58,179 INFO [M:0;jenkins-hbase4:41907] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41907 2023-02-19 08:00:58,180 DEBUG [M:0;jenkins-hbase4:41907] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41907,1676793653468 already deleted, retry=false 2023-02-19 08:00:58,332 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:58,332 INFO [M:0;jenkins-hbase4:41907] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41907,1676793653468; zookeeper connection closed. 2023-02-19 08:00:58,332 ERROR [Listener at localhost/43261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@161839b7 rejected from java.util.concurrent.ThreadPoolExecutor@1227afac[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:58,333 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): master:41907-0x1006b98927e0000, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:58,333 ERROR [Listener at localhost/43261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@313af490 rejected from java.util.concurrent.ThreadPoolExecutor@1227afac[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:58,432 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:58,432 INFO [RS:1;jenkins-hbase4:46731] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46731,1676793653537; zookeeper connection closed. 2023-02-19 08:00:58,432 ERROR [Listener at localhost/43261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6cfa1e23 rejected from java.util.concurrent.ThreadPoolExecutor@561c148d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:58,432 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:46731-0x1006b98927e0002, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:58,432 ERROR [Listener at localhost/43261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14493206 rejected from java.util.concurrent.ThreadPoolExecutor@561c148d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:58,432 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@72b2d9e6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@72b2d9e6 2023-02-19 08:00:58,532 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:58,532 INFO [RS:0;jenkins-hbase4:33899] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33899,1676793653516; zookeeper connection closed. 2023-02-19 08:00:58,532 ERROR [Listener at localhost/43261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5702f134 rejected from java.util.concurrent.ThreadPoolExecutor@45f47597[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:58,533 DEBUG [Listener at localhost/43261-EventThread] zookeeper.ZKWatcher(600): regionserver:33899-0x1006b98927e0001, quorum=127.0.0.1:58569, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-19 08:00:58,533 ERROR [Listener at localhost/43261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5eb17835 rejected from java.util.concurrent.ThreadPoolExecutor@45f47597[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-19 08:00:58,533 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f8cc4a6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f8cc4a6 2023-02-19 08:00:58,533 INFO [Listener at localhost/43261] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-19 08:00:58,533 WARN [Listener at localhost/43261] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:58,537 INFO [Listener at localhost/43261] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:58,638 WARN [BP-969800823-172.31.14.131-1676793652836 heartbeating to localhost/127.0.0.1:46177] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:58,638 WARN [BP-969800823-172.31.14.131-1676793652836 heartbeating to localhost/127.0.0.1:46177] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-969800823-172.31.14.131-1676793652836 (Datanode Uuid 15964414-18f1-4296-a396-c45cc5bb61d1) service to localhost/127.0.0.1:46177 2023-02-19 08:00:58,638 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/cluster_f34c09f6-c094-f5d6-6955-7cea7e88914d/dfs/data/data3/current/BP-969800823-172.31.14.131-1676793652836] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:58,639 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/cluster_f34c09f6-c094-f5d6-6955-7cea7e88914d/dfs/data/data4/current/BP-969800823-172.31.14.131-1676793652836] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:58,641 WARN [Listener at localhost/43261] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-19 08:00:58,643 INFO [Listener at localhost/43261] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:58,744 WARN [BP-969800823-172.31.14.131-1676793652836 heartbeating to localhost/127.0.0.1:46177] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-19 08:00:58,745 WARN [BP-969800823-172.31.14.131-1676793652836 heartbeating to localhost/127.0.0.1:46177] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-969800823-172.31.14.131-1676793652836 (Datanode Uuid dac78fcc-409b-4d07-ba49-52f0f58e1139) service to localhost/127.0.0.1:46177 2023-02-19 08:00:58,745 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/cluster_f34c09f6-c094-f5d6-6955-7cea7e88914d/dfs/data/data1/current/BP-969800823-172.31.14.131-1676793652836] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:58,745 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bcf39ac5-be5d-6d24-1ce4-a0720e42f453/cluster_f34c09f6-c094-f5d6-6955-7cea7e88914d/dfs/data/data2/current/BP-969800823-172.31.14.131-1676793652836] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-19 08:00:58,756 INFO [Listener at localhost/43261] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-19 08:00:58,871 INFO [Listener at localhost/43261] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-19 08:00:58,895 INFO [Listener at localhost/43261] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-19 08:00:58,909 INFO [Listener at localhost/43261] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 274) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46177 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41907,1676793653468)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:46177 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:46177 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:46177 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:46177 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:46177 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/43261 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:46177 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=594 (was 576) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=412 (was 378) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 170), AvailableMemoryMB=10088 (was 8985) - AvailableMemoryMB LEAK? -